Dynamical Zeta Functions, 
Nielsen Theory 
and Reidemeister Torsion 



Alexander FePshtyn 



Contents 



Introduction 

p.l From Riemann zeta function to dynamical zeta functions . . . 

p. 1.1 Riemann zeta function 

p. 1.2 Problems concerning zeta functions 

p. 1.3 Important types of zeta functions 

J. 1.4 Hassc-Wcil zeta function 

p. 1.5 Dynamical zeta functions 

p. 2 Dynamical zeta functions and Nielsen fixed point theory . . . 

p. 3 Congruences for Reidemeister numbers 

p. 4 Reidemeister torsion! 

p. 5 Table of contents 



1 Nielsen Fixed Point Theory| 


1.1 History 


1.2 Lifting classes and fixed point classes 




1.2.1 The influence of a homotopy 


1.3 Reidemeister numbers 




1.3.1 Reidemeister numbers of a continuous map 


1.3.2 Reidemeister numbers of a group endomorphism . . . . 


1.4 Nielsen numbers of a continuous map] 




1.4.1 The fixed point index 


1.4.2 Nielsen numbers 


1.4.3 The least number of fixed points] 



2 The Reidemeister zeta function 

2.1 A Convolution Product .... 

2.2 Pontryagin Duality 



1 



2 



2.3 Eventually commutative endomorphisms 



2.3.1 Trace formula for the Reidemeister numbers of eventu- 



ally commutative endomorphisms 



2.3.2 Rationality of Reidemeister zeta functions of eventu- 



ally commutative endomorphisms - first proof 



2.3.3 Functional equation for the Reidemeister zeta function 



of an eventually commutative endomorphism 



2.3.4 Rationality of Reidemeister zeta functions of eventu- 



ally commutative endomorphisms - second proof. 



2.3.5 Connection of the Reidemeister zeta function with the 



Lefschetz zeta function of the dual map 



36 
36 
39 
43 
45 

46 

48 

53 
57 
58 
59 
60 

63 
65 

3.1 Radius of Convergence of the Nielsen zeta function! 65 



274" Endomorphisms of finite groups 



2.5 



Endomorphisms of the direct sum of a free Abelian and a 
finite group 



2.6 Endomorphisms of nilpotent groups| 



2.6.1 Functional equation 



2.7 The Reidemeister zeta function and group extensions. 



2.8 The Reidemeister zeta function of a continuous map 



EXT 



The Reidemeister zeta function of a continuous map 
and Serre bundles 



3 The Nielsen zeta function 



3.1.1 Topological entropy] 65 



3.1.2 Algebraic lower estimation for the Radius of Convergence 67 
3.2 Nielsen zeta function of a periodic map| 71 



3.3 Orientation-preserving homeomorphisms of a compact surface] 74 



3.3.1 Ceometry of the Mapping Torus and Radius of Con- 



vergence 



|3.4 The Jiang subgroup and the Nielsen zeta function 



p. 5 Polyhedra with finite fundamental group 



3.6 Nielsen zeta function in other special cases 



75 
77 
81 
87 



3.6.1 Pseudo-Anosov homeomorphism of a compact surface 



377 The Nielsen zeta function and Serre bundles.| 89 

90 



3.8 Examples 



4 Reidemeister and Nielsen zeta functions modulo normal sub- 



group, minimal dynamical zeta functions] 



471 Reidemeister and INieisen zeta functions modulo a normal sub- 



group 



4.1.1 Radius of Convergence of the mod K Nielsen zeta func- 



tion 



4.1.2 mod K Nielsen zeta function of a periodic map 
4.2 Minimal dynamical zeta function 



4.2.1 Radius of Convergence of the minimal zeta function 



94 

94 

95 
96 
98 
98 



5 Congruences for Reidemeister and Nielsen numbers| 100 

p.l Irreducible Representation and the Unitary Dual of G] 100 



EI 



Endomorphism of the Direct Sum of a Free Abelian and a 
Finite Group| 101 



Endomorphism of almost 



Abelian 



groups 



103 



5.3.1 



Compact Groups! 104 

5.3.2 Almost Abelian groups] 105 

|5.4 Endomorphisms of nilpotent groups] 107 

[5.5 Main Theorem! 108 



p. 6 Congruences for Reidemeister numbers of a continuous map| . 110 



|5. 7 Congruences for Reidemeister numbers of equivariant group 

endomorphisms| Ill 



f>. 8 Congruences for Reidemeister numbers of equivariant maps| . . 115 

|5. 9 Congruences lor Nielsen numbers of a continuous map 116 

|5. 10 Some conjectures for" 



wi 



der 



classes ol 



roups 118 



6 The Reidemeister torsion 



119 



|6.1 Preliminaries! 119 



|6.2 4'he Reidemeister zeta Function and the Reidemeister Torsion 



of the Mapping Torus of the dual map.| 123 



|6.3 The connection between the Reidemeister torsion, eta-invariant 



the Rochlin invariant and theta multipliers via the dynamical 



zeta functions 125 



5.3.1 Rochlin invariant! 125 



3.3.2 The Bismut-Freed-Witten Holonomy Theorem! 126 



5.3.3 Connection with Reidemeister torsion! 129 



3.3.4 The Rcidcmcistcr torsion and thcta-multiplicrs 130 



pA Topology of an attraction domain and the Reidemeister torsion| 131 



5.4.1 Introduction! 131 



3.4.2 Morse-Smale systems| 132 

5.4.3 A formula for the Euler characteristic! 136 



3.4.4 The Reidemeister torsion of the level surface of a Lya- 



punov function and of the attraction domain of the 



attractor 137 



|6.5 Integrable Hamiltonian systems and the Reidemeister torsion] . 141 



Introduction 



0.1 From Riemann zeta function to dynamical 
zeta functions 

In this subsection we shall try to explain where dynamical zeta functions 
come from . In a sense the study of dynamical zeta functions is part of the 
theory of dynamical systems, but it is also intimately related to algebraic 
geometry, number theory, topology and statistical mechanics. 

0.1.1 Riemann zeta function 

The theory of the Riemann zeta function and its generalisations represent 
one of the most beatiful developments in mathematics. The Riemann zeta 
function is that function defined on {s E (T : Re(s) > 1} by the series 

OO 1 

n=0 U 

There is a second representation of ( which was discovered by Euler in 1749 
and which is the reason for the significance of the Riemann zeta function in 
arithmetic. This is Euler product formula: 

c(s)= n (i-p-r 1 - 

p prime 

Riemann's significant contribution here was his consideration in 1858 of the 
zeta function as an analytic function. He first showed that the zeta function 
has an analytic continuation to the complex plane as a meromorphic func- 
tion with a single pole at s = 1 whose properties can on the one hand be 
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investigated by the techniques of complex analysis, and on the other yield 
difficult theorems concerning the integers JFS] . It is this connection between 



the continuous and the discrete that is so wonderful. Riemann also showed 
that the zeta function satisfied a functional equation of the form 

C(l - s) = 7 ( a ) ■ COO 

where 

7 ( S )=vr 1 / 2 --r( S /2)/r((l- S )/2) 

and T is the Euler gamma-function. In the course of his investigations Rie- 
mann was led to suspect that all nontrivial zeros are on the line Re(s) = 1/2, 
this is the Riemann Hypothesis which has been the central goal of research 
to the present day. Although no proof has yet appeared various weak forms 
of this conjecture, and in other contexts, analogues of it have been of con- 
siderable significance. 



0.1.2 Problems concerning zeta functions 

Since the 19 th century, many special functions called zeta functions have 
been defined and investigated. The main problems concerning zeta functions 
are: 

(I) Creation of new zeta functions. 

(II) Investigation of the properties of zeta functions. Generally , zeta 
functions have the following properties in common: 1) They are meromorphic 
on the whole complex plane ; 2) they have Dirichlet series expansions ; 3) they 
have Euler product expansions ; 4) they satisfy certain functional equations; 
5) their special values play important role. Also, it is an important problem 
to find the poles, residues, and zeros of zeta functions . 

(III) Application to number theory, geometry, dynamical systems. 

(IV) Study of the relations between different zeta functions. 

Most of the functions called zeta functions or L-functions have the prop- 
erties of problem (II). 



0.1.3 Important types of zeta functions 



For a general discussion of a zeta functions see article " Zeta functions " in the 
Encyclopedic Dictionary of Mathematics fl7 |. The following is a classification 



of the important types of zeta functions that are already known: 
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1) The zeta and L-functions of algebraic numbers fields: the Riemann zeta 
function, Dirichlet L-functions, Dedekind zeta functions, Hecke L-functions, 
Artin L-functions. 

2) The p-adic L-functions of Leopoldt and Kubota. 

3) The zeta functions of quadratic forms: Epstein zeta functions, Siegel 
zeta functions. 

4) The zeta functions associated with Hecke operators. 

5) The zeta and L-functions attached to algebraic varieties defined over 
finite fields: Artin zeta function, Hasse-Weil zeta functions. 

6) The zeta functions attached to discontinuous groups : Selberg zeta 
functions. 

7) The dynamical zeta functions: Artin-Mazur zeta function, Lefschetz 
zeta function, Ruelle zeta function for discrete dynamical systems, Ruelle 
zeta function for flows. 

0.1.4 Hasse-Weil zeta function 

Let V be a nonsingular projective algebraic variety of dimension n over a 
finite field k with q elements. The variety V is thus defined by homoge- 
nous polynomial equations with coefficients in the field k for m + 1 variables 
xo, X\, x m . These variables are in the algebraic closure k of the field k, 
and constitute the homogeneous coordinates of a point of l/.The variety V 
is invariant under the Frobenius map F : (xo, X\, x m ) — > (xl, x\, x^). 
Arithmetic considerations lead Hasse and Weil to introduce a zeta function 
which counts the points of V with coordinates in the different finite exten- 
sions of the field k, or equivalently points of V which are fixed under F n for 
some n > 1: 




Note that ((z, V) can be written as a Euler product 



c(*,v)=n 



i 



7 



l-z#v' 



over all primitive periodic orbits 7 of F on V. For comparison with Riemann's 
zeta function one has to put z = q~ s . Certain conjectures proposed by 
Weil [^] on the properties of ((z,V) led to lot of work by Weil, Dwork, 
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Grothendieck, and complete proof was finally obtained by Deligne |15j . The 
story of the Weil conjectures is one of the most striking instances exhibiting 
the fundamental unity of mathematics. It is found that ((z, V) is a rational 
function of z with a functional equation : 



c(*,v)=n^(*) 



2m 

(_!)!+! 



i=0 



where the zeros of the polynomial Pi have absolute value q~ 1 / 2 and the Pi(z) 
have a cohomological interpretation: the polynomial Pi is roughly the char- 
acteristic polynomial associated with the induced action of the Frobenius 
morphism on the etale cohomology: Pi{z) = det(l — z ■ F*\H l (V)). 



0.1.5 Dynamical zeta functions 

Inspired by the Hasse-Weil zeta function of an algebraic variety over a finite 
field, Artin and Mazur || defined the Artin - Mazur zeta function for an 
arbitrary map / : X — > X of a topological space X: 

Ff(z) := exp 

where F{f n ) is the number of isolated fixed points of f n . Artin and Mazur 
showed that for a dense set of the space of smooth maps of a compact smooth 
manifold into itself the Artin-Mazur zeta function Ff(z) has a positive ra- 
dius of convergence. Later Manning |)4] proved the rationality of the Artin - 




Mazur zeta function for diffeomorphisms of a smooth compact manifold sat- 
isfying Smale axiom A, after partial results were obtained by Williams and 
Guckenheimer. On the other hand there exist maps for which Artin-Mazur 



zeta function is transcendental 111 



The Artin-Mazur zeta function was adopted later by Milnor and Thurston 
to count periodic points for a piecewise monotone map of the interval. 
The Artin-Mazur zeta function was historically the first dynamical zeta 
function for discrete dynamical system. The next dynamical zeta function 
was defined by Smale j|7| .This is the Lefschetz zeta function of discrete 



dynamical system: 

Lf(z) := exp 
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, where 

dimX 
fc=0 

is the Lefschetz number of f n . Smale considered Lf(z) in the case when 
/ is diffeomorphism of a compact manifold, but it is well defined for any 
continuous map / of compact polyhedron X. The Lefschetz zeta function is 
a rational function of z and is given by the formula: 

dimX 

L f (z)= J] det(/-/* fc ^) ( - 1)+1 . 

k=0 



Afterwards, J.Franks [|38| defined reduced mod 2 Artin-Mazur and Lef- 
schetz zeta functions, and D. Fried |RJ defined twisted Artin-Mazur and 
Lefschetz zeta functions, which have coefficients in the group rings ZZH or 
of an abelian group H. The above zeta functions are directly analogous 
to the Hasse-Weil zeta function. 

Ruelle has found another generalization of the Artin-Mazur zeta function. 
He was motivated by ideas from equilibrium statistical mechanics and has 



replaced in the Artin-Mazur zeta function |82|] simple counting of the periodic 



points by counting with weights. He defined the Ruelle zeta function as 



/ 00 n n—1 

F f °{z) : = exp E - E II 9{f h {x)) 

\n=l n xeFix (/") k=0 

where g : X — > W is a weight function(if g = 1 we recover Ff(z)). 

Dynamical zeta functions have relations with statistical mechanics( en- 
tropy, pressure, Gibbs states, equilibrium states). Manning used Markov 
partitions and corresponding symbolic dynamics in his proof of the rational- 
ity of the Artin-Mazur zeta function. This symbolic dynamics is reminiscent 
of the statistical mechanics of one-dimensional lattice spin system. 



0.2 Dynamical zeta functions and Nielsen 
fixed point theory 

In contrast with the Artin- Mazur zeta function which counts the periodic 
points of the map geometrically, the Lefschetz zeta function does this alge- 
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braically. There is another way of counting the fixed points of f n - according 
to Nielsen g|. 

Let p : X — > X be the universal covering of X and / : X — > X a lifting 
of /, ie. p o f — f o p. Two liftings / and /' are called conjugate if there is a 
7 G r = 71"! (X) such that /' = 7 o / o 7 -1 . The subset p(Fix(f)) C Fix(f) 
is called i/ie /ised point c/ass 0// determined by the lifting class [/]. A fixed 
point class is called essential if its index is nonzero. The number of lifting 
classes of / (and hence the number of fixed point classes, empty or not) 
is called the Reidemeister Number of /, denoted R(f)- This is a positive 
integer or infinity. The number of essential fixed point classes is called the 
Nielsen number of /, denoted by N(f). The Nielsen number is always 
finite. R(f) and N(f) are homotopy type invariants. In the category of 
compact, connected polyhedra the Nielsen number of a map is equal to the 
least number of fixed points of maps with the same homotopy type as /.In 
Nielsen fixed point theory the main objects for investigation are the Nielsen 
and Reidemeister numbers and their modifications ||51|| . 

Let G be a group and <ft '■ G — > G an endomorphism. Two elements 
a, a' G G are said to be — conjugate iff there exists 7 G G such that a 1 = 
7.<x0(7) _1 . The number of 0-conjugacy classes is called the Reidemeister 
number of 0, denoted by R(<f>). 



In papers |23|, ^4], |25|, Q we have introduced new dynamical zeta func- 
tions connected with Nielsen fixed point theory. We defined the Nielsen zeta 
function of / and Reidemeister zeta functions of / and 4> as power series: 

R+(z) := expff^A 



Vn=l n 



00 T3( fn\ 



R f (z) := expfX 7 



■z" 



n=l n 



tf, W := exp (t Ni} " ] 



Z 



Kn=l 71 



We assume that R(f n ) < 00 and R(4> n ) < 00 for all n > 0. 

We have investigated the following problem: for which spaces and maps 
and for which groups and endomorphisms are the Nielsen and Reidemeis- 
ter zeta functions a rational functions?When they have a functional equa- 
tion?Are these functions algebraic functions? 
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In we proved that the Nielsen zeta function has a positive radius 
of convergence which admits a sharp estimate in terms of the topological 
entropy of the map. Later, in we propose another prove of positivity 
of radius and proved an exact algebraic lower estimation for it. With the 
help of Nielsen - Thurston theory of surface homeomorphisms , in [74 



we proved that for an orientation-preserving homeomorphism of a compact 
surface the Nielsen zeta function is either a rational function or the radical 



of rational function. For a periodic map of any compact polyhedron in [173 



we proved a product formula for Nielsen zeta function which implies that 
Nielsen zeta function is a radical of a rational function. 

The investigation and computation of the Reidemeister zeta function 
R ( j ) (z)of a group endomorphism is an algebraic ground of the computation 
and investigation of zeta functions Rf(z) and Nf(z). In |25| we investigated 
the behavior of i?^(2;)under the extension of a group and proved rationality 
and a functional equation of R^{z) and a trace formula for the R((j) n ) for the 
endomorphism of a finitely generated free Abelian group and group 2Z/pZ. 
An endomorphism <ft : G — > G is said to be eventually commutative if there 
exists a natural number n such that the subgroup <f) n (G) is commutative. A 
map / : X — > X is said to be eventually commutative if the induced endo- 
morphism on fundamental group is eventually commutative. In [Jy], [33 



we proved that R${z) is a rational function with functional equation in the 
case of any endomorphism <fi of any finite group G and in the case that <fi 
is eventually commutativ e and G is finitely generated. As a consequence 
we obtained rationality and a functional equation for Rf(z) where either the 
fundamental group of X is finite, or the map / is eventually commutative. We 
obtained sufficient conditions under which the Nielsen zeta function coincides 
with the Reidemeister zeta function and is a rational function with functional 
equation. As an application we calculate the Reidemeister and Nielsen zeta 
functions of all self-maps of lens spaces, nilmanifolds and tori. 

In [El, I2R E7[ we found a connection between the rationality of the Nielsen 



and Reidemeister zeta functions for the maps of fiber, base and total space of 
a fiber map of a Serre bundle using results of Brown, Fadell, and You (see 
[ j5lH ) about Nielsen and Reidemeister numbers of a fiber map. 

In [0] we proved the rationality of the Reidemeister zeta function and 
the trace formulas for the Reidemeister numbers of group endomorphisms in 
the following cases: the group is finitely generated and an endomorphism is 
eventually commutative; the group is finite ; the group is a direct sum of a 
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finite group and a finitely generated free Abelian group; the group is finitely 
generated, nilpotent and torsion free . 



0.3 Congruences for Reidemeister numbers 



In his article [7£], Dold found a remarkable arithmetical property of the 
Lefschetz numbers for the iterations of a map /. He proved the following 
formula 

Y.M- L(f n/d )=0modn 

d\n 

where n is any natural number and \x is the Mobius function. This result 



had previously been obtained for prime n by Zabreiko, Krasnosel'skii ||102 
and Steinlein 

The congruences for Lefschetz numbers are directly connected with the 
rationality of the Lefschetz zeta function J79| . 

In |31j , |3Sj we proved, under additional conditions, similar congruences : 



5>(d) ■ i?(0 n/d ) ^Ornod 

d\n 



n. 



J2 Kd) ■ R(f n/d ) = mod 

d\n 

for the Reidemeister numbers of the iterations of a group endomorphism </> 
and a map /. 

This result implies , in special cases , the corresponding congruences for 
the Nielsen numbers. For n-toral maps in the case when Jiang subgroup 
coincide with fundamental group this congruences for Nielsen numbers were 



proved by Heath, Piccinini, and You (29 
In 



|3q1 , we generalize the arithmetic congruence relations among the Rei- 
demeister numbers of iterates of maps to similar congruences for Reidemeister 
numbers of equivariant group endomorphisms and maps. 

In the article we conjected a general connection between the Reide- 
meister number of a group endomorphism and the number of fixed points of 
the induced map on the space of irreducible unitary representations. This can 
be reformulated in terms of self-maps and pullbacks of vector bundles. The 
results 



32] , |33|] are essentially proofs of these conjectures under the condition 



that <p is eventually commutative or G is finite. 
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0.4 Reidemeister torsion. 

Dynamical zeta functions in the Nielsen theory are closely connected with 
the Reidemeister torsion. 

Reidemeister torsion is a very important topological invariant which has 
useful applications in knots theory, quantum field theory and dynamical sys- 
tems.In 1935 Reidemeister classified up to PL equivalence the lens spaces 
S 3 /T where T is a finite cyclic group of fixed point free orthogonal transfor- 
mations. He used a certain new invariant which was quickly extended by 
Franz , who used it to classify the generalized lens spaces S 2n+1 /T. This 
invariant is a ratio of determinants concocted from a T-equivariant chain 
complex of S 2n+l and a nontrivial character p : T — > U(l) of V. Such a p 
determines a flat bundle E over S 2n+1 /T such that E has holonomy p. The 
new invariant is now called the Reidemeister torsion, or R-torsion of E. 

The results of Reidemeister and Franz were extended by de Rham to 
spaces of constant curvature +1. 

Whitehead refined and generalized Reidemeister torsion in defining the 
torsion of a homotopy equivalence in 1950, and his work was to play a crucial 
role in the development of geometric topology and algebraic K-theory in the 
60 's. The Reidemeister torsion is closely related to the K\ groups of algebraic 
.fT-theory. 

Later Milnor identified the Reidemeister torsion with the Alexander poly- 
nomial, which plays a fundamental role in the theory of knots and links. 



In 1971, Ray and Singer [77] introduced an analytic torsion associated 
with the de Rham complex of forms with coefficients in a flat bundle over 
a compact Riemannian manifold, and conjectured it was the same as the 
Reidemeister torsion associated with the action of the fundamental group on 
the covering space, and the representation associated with the flat bundle. 



The Ray- Singer conjecture was established independently by Cheeger |T3 



and Miiller [BE] a few years later. 



In 1978 A.Schwartz Kl showed how to construct a quantum field theory 



on a manifold M whose partition function is a power of the analytical torsion 
of M. Witten ||101|| have used analytical torsion to study non-Abelian Chern- 



Simons gauge field theory. Its partition function is the Witten-Reshetikhin- 
Turaev invariant ||95|| for the three manifold M and the analytic torsion ap- 
pears naturally in the asymptotic formula for the partition function obtained 



by the method of stationary phase approximation ||101 
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Recently, the Reidemeister torsion has found interesting applications in 
dynamical systems theory. A connection between the Lefschetz type dynam- 
ical zeta functions and the Reidemeister torsion was established by D. Fried 
4~0[| . The work of Milnor |JIJ was the first indication that such a connection 



exists. Fried also has shown that, for some flows, the value at of the Ruelle 
zeta function coincides with the Reidemeister torsion. 



In |26[ , |32|, [33|, [34j we established a connection between the Reidemeister 
torsion and Reidemeister zeta function. We obtained an expression for the 
Reidemeister torsion of the mapping torus of the dual map of a group endo- 
morphism, in terms of the Reidemeister zeta function of the endomorphism. 
The result is obtained by expressing the Reidemeister zeta function in terms 
of the Lefschetz zeta function of the dual map, and then applying the the- 
orem of D. Fried. What this means is that the Reidemeister torsion counts 
the fixed point classes of all iterates of map / i.e. periodic point classes of /. 

In |29| we established a connection between the Reidemeister torsion of a 
mapping torus, the eta- invariant, the Rochlin invariant and the multipliers of 
the theta function. The formula is obtained via the Lefschetz zeta function 
and the results on the holonomy of determinant line bundles due to Witten 
[IUH |, Bismut-Freed |J, and Lee, Miller and Weintraub [5T|. 

Note, that the work of Turaev [9|] was the first indication that the Rochlin 
invariant is connected with the Reidemeister torsion for three-dimensional 
rational homology spheres. 



In |43[ , we proved an analogue of the Morse inequalities for the attraction 
domain of an attractor, and the level surface of the Lyapunov function. These 
inequalities describe the connection between the topology of the attraction 
domain and dynamic of a Morse-Smale flow on the attractor. 



In p6| , |30|1 we described with the help of the Reidemeister torsion the 
connection between the topology of the attraction domain of an attractor 
and the dynamic of flow with circular chain-recurrent set on the attractor. 
We showed that for flow with circular chain- recurrent set, the Reidemeister 
torsion of the attraction domain of an attractor and Reidemeister torsion of 
the level surface of the Lyapunov function is a special value of the twisted 
Lefschetz zeta function building via closed orbits in the attractor. 

In [[30 1 we found that for the integrable Hamiltonian system on the four- 
dimensional symplectic manifold, the Reidemeister torsion of the isoenergetic 
surface counts the critical circles (which are the closed trajectories of the 
system) of the second independent Bott integral on this surface. 
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0.5 Table of contents 

The monograph consists of four parts. Part I( Chapter 1) presents a brief 
account of the Nielsen fixed point theory. Part II( Chapters 2 - 4 ) deals with 
dynamical zeta functions connected with Nielsen fixed point theory. Part III 
( Chapter 5) is concerned with congruences for the Reidemeister and Nielsen 
numbers. Part IV (Chapter 6) deals with the Reidemeister torsion . 

The content of the chapters should be clear from the headings. The 
following remarks give more directions to the reader. 

In Chapter 1 we define the lifting and fixed point classes, fixed point index, 
Reidemeister and Nielsen numbers. The relevant definitions and results will 
be used throughout the book. 

In Chapter 2 - 4 we introduce the Reidemeister zeta functions of a group 
endomorphism and of a map and the Nielsen zeta function of a map which 
are the main objects of the monograph. 

In Chapter 2 we prove that the Reidemeister zeta function of a group 
endomorphism is a rational function with functional equation in the following 
cases: the group is finitely generated and an endomorphism is eventually 
commutative; the group is finite ; the group is a direct sum of a finite group 
and a finitely generated free abelian group; the group is finitely generated, 
nilpotent and torsion free. As a consequence we obtained rationality and a 
functional equation for the Reidemeister zeta function of a continuous map 
where the fundamental group of X is as above. 

In Chapter 3 we show that the Nielsen zeta function has a positive radius 
of convergence which admits a sharp estimate in terms of the topological 
entropy of the map. We also give an exact algebraic lower estimation for the 
radius. With the help of Nielsen - Thurston theory of surface homeomorphisms 
we prove that for an orientation-preserving homeomorphism of a compact 
surface the Nielsen zeta function is either a rational function or the radical 
of rational function. For a periodic map of a compact polyhedron we prove 
a product formula for Nielsen zeta function which implies that Nielsen zeta 
function is a radical of a rational function. In section 3.4 and 3.5 we give 
sufficient conditions under which the Nielsen zeta function coincides with 
the Reidemeister zeta function and is a rational function with functional 
equation. In section 3.6 we describe connection between the rationality of 
the Nielsen zeta functions for the maps of fiber, base and total space of a 
fiber map of a Serre bundle. We would like to mention that in all known 
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cases the Nielsen zeta function is a nice function. By this we mean that it is 
a product of an exponential of a polynomial with a function some power of 
which is rational. May be this is a general pattern. 

In Chapter 4 we generalize the results of Chapter 2-3 to the Nielsen and 
Reidemeister zeta functions modulo normal subgroup of the fundamental 
group. 

In Chapter 5 we prove analog of Dold congruences for Reidemeister and 
Nielsen numbers. 

In Chapter 6 we explain how dynamical zeta functions give rise to the 
Reidemeister torsion, a very important topological invariant . In section 6.2 
we establish a connection between the Reidemeister torsion and Reidemeis- 
ter zeta function. We obtain an expression for the Reidemeister torsion of 
the mapping torus of the dual map of a group endomorphism, in terms of 
the Reidemeister zeta function of the endomorphism. This means that the 
Reidemeister torsion counts the fixed point classes of all iterates of map / 
i.e. periodic point classes of /. 

In section 6.3 we establish a connection between the Reidemeister tor- 
sion of a mapping torus, the eta-invariant, the Rochlin invariant and the 
multipliers of the theta function. 

In section 6.4 we describe with the help of the Reidemeister torsion and 
of an analog of Morse inequalities the connection between the topology of 
the attraction domain of an attractor and the dynamic of the system on the 
attractor. 

In section 6.5 we show that for the integrable Hamiltonian system on 
the four-dimensional symplectic manifold, the Reidemeister torsion of the 
isoenergetic surface counts the critical circles(which are the closed trajectories 
of the system ) of the second independent Bott integral on this surface. 

A part of this monograph grew out of the joint papers of the author 
with V.B. Pilyugina and R. Hill written in 1985-1995. Their collaboration is 
gratefully appreciated. 

This book had its beginnings in talks which the author gave at Rochlin 
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Rochlin on our approach to the subject of the book. 

The author would like to thank D. Anosov, M.Gromov, B.Jiang, S. Pat- 
terson, V.Turaev, O. Viro, P. Wong for useful discussions and comments. 
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and help. 
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Chapter 1 

Nielsen Fixed Point Theory 



In this section we give a brief review of the Nielsen theory. 

1.1 History 

Fixed point theory started in the early days of topology, because of its close 
relationship with other branches of mathematics. Existence theorems are of- 
ten proved by converting the problem into an appropriate fixed point prob- 
lem. Examples are the existence of solutions for elliptic partial differential 
equations, and the existence of closed orbits in dynamical systems. In many 
problems, however, one is not satisfied with the mere existence of a solution. 
One wants to know the number, or at least a lower bound for the number 
of solutions. But the actual number of fixed points of a map can hardly be 
the subject of an interesting theory, since it can be altered by an arbitrarily 
small perturbation of the map. So, in topology, one proposes to determine 
the minimal number of fixed points in a homotopy class. This is what Nielsen 
fixed point theory about. Perhaps the best known fixed point theorem in 
topology is the Lefschetz fixed point theorem 

Theorem 1 pty Let X be a compact polyhedron, and f : X — > X be a map. 
If the Lefschetz number L(f) ^ 0, then every map homotopic to f has a fixed 
point. 

The Lefschetz number is the total algebraic count of fixed points.lt is a 
homotopy invariant and is easily computable. 
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So, the Lefschetz theorem, along with its special case, the Brouwer fixed 
point theorem, and its generalization, the widely used Leray-Schauder theo- 
rem in functional analysis, can tell existence only. In contrast, the chronolog- 
ically first result of Nielsen theory has set a beautiful example of a different 
type of theorem 

Theorem 2 ff/Dj Let f : T 2 —* T 2 be a map of the torus. Suppose that the 
endomorphism induced by f on the fundamental group tt\{T 2 ) = Z © Z is 
represented by the 2x2 integral matrix A. Then the least number of fixed 
points in the homotopy class of f equals the absolute value of the determinant 
of E — A, where E is the identity matrix, i.e. 

Mm{#Fix (jg)\g~f}=\ det(E - A)\. 

It can be shown that det(E — A) is exactly L(f) on tori and | det(E — A) \ is 
the Nielsen number N(f) on tori. This latter theorem says much more than 
the Lefschetz theorem specialised to the torus, since it gives a lower bound 
for the number of fixed points, or it confirms the existence of a homotopic 
map which is fixed point free. The proof was via the universal covering space 
R 2 of the torus. From this instance evolved the central notions of Nielsen the- 
ory - the fixed point classes and the Nielsen number. 

Roughly speaking, Nielsen theory has two aspects. The geometric aspect 
concerns the comparison of the Nielsen number with the least number of 
fixed points in a homotopy class of maps. The algebraic aspect deals with 
the problem of computation for the Nielsen number. Nielsen theory is based 
on the theory of covering spaces. An alternative way is to consider nonempty 
fixed point classes only, and use paths instead of covering spaces to define 
them. This is certainly more convenient for some geometric questions. But 
the covering space approach is theoretically more satisfactory, especially for 
computational problems, since the nonemptiness of certain fixed point classes 
is often the conclusion of the analysis, not the assumption. 

Now let us introduce the basic idea of Nielsen theory by an elementary 
example ( see H5Tf ) 

Example 1 Let f : S 1 — > S 1 be a map of the circle. Suppose the degree of 
f is d. Then the least number of fixed points in the homotopy class of f is 
\l-d\. 
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Proof Let S l be the unit circle on the complex plane, i.e. S 1 = {z e 
C | \z\ = 1}. Let p : R — > S* 1 be the exponential map = z = e ld . Then 6> is 
the argument of z, which is multi- valued function of z. For every / : S* 1 — > S* 1 , 
one can always find "argument expressions" ( or liftings) / : i? — > R such 
that f(e te ) = e l ^ e \ in fact a whole series of them, differing from each other 
by integral multiples of 2tt . For definiteness let us write f for the argument 
expression with /o(0) lying in [0,27r),and write fk = fo + 2k-a. Since the 
degree of / is d, the functions f k are such that fk(9 + 2n) = f k (9) + 2dn. 
For example, if f(z) = —z d , then f k (9) = d6 + (2k + i)ir. It is evident that 
if z = e 10 is a fixed point of /, i.e. z = f(z) ,then 9 is a fixed point of some 
argument expression of /, i.e. 9 = fk(&) for some k. On the other hand, if 
6 is a fixed point of fk, q is an integer, then 9 + 2qn is a fixed point of fi iff 
I — k — q(l — d). This follows from the calculation 

fi(6 + 2qn) = f k (9 + 2gvr) + 2(1 - k)n = f k (9) + 2qdit + 2(1 - k)n = 

= (9 + 2qn) + 2tt{(/ - jfe) - q(l - d)}. 

Thus , if / ^ fc mod (1 — d), then a fixed point of f k and a fixed point 
of fi can never correspond to the same fixed point of / , i.e. p(Fix (fk)) H 
p(Fix (fi)) = 0. So, the argument expressions fall into equivalence classes ( 
called lifting classes) by the relation // ~ f k iff k = I mod (1 — d), and the 
fixed points of / split into |1 — d\ classes (called fixed point classes) of the 
form p(Fix (fk))- That is , two fixed points are in the same class iff they 
come from fixed points of the same argument expression. Note that each 
fixed point class is by definition associated with a lifting class, so that the 
number of fixed point classes is |1 — d\ if d ^ 1 and is oo if d — 1. Also 
note that a fixed point class need not be nonempty. Now, to prove that a 
map / of degree d has at least |1 — d\ fixed points, we only have to show 
that every fixed point class is nonempty, or equivalently, that every argument 
expression has a fixed point, if d ^ 1. In fact, for each k, by means of the 
equality f k (9 + 2tt) — f k (9) = 2dn, it is easily seen that the function 9 — f k (9) 
takes different signs when 9 approaches ±oo, hence fk(9) has at least one 
fixed point. That |1 — d\ is indeed the least number of fixed points in the 
homotopy class is seen by checking the special map f(z) = —z d . 

The following sections can be considered as generalization of this simplest 
example. 
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1.2 Lifting classes and fixed point classes 

Let / : X — > X be a continuous map of a compact connected polyhedron. Let 
p : X — > X be the universal covering of X. A lifting of / is a map / : X — > X 
such that p o f — f o p. A covering translation is a map 7 : X — > X such 
that p o 7 = p, i.e. a lifting of the identity map. Now we describe standard 
facts from covering space theory 

Proposition 1 (1) For any x$ G X and any Xq,x' G p _1 (:co); there is a 
unique covering translation 7 : X — > X s«c/i £/ia£ 7(2:0) = £' . T/ie covering 
translations of X form a group Y which is isomorphic to 7Ti(X) . 
^ Lei / : X — > X fre a continuous map. For given x G X and 27 = f(x ), 
pickxo G p _1 (£o) and Xi G arbitrarily. Then, there is a unique lifting 

of f such that f(xo) = x\. 

( 3) Suppose f is a lifting of f , and a, (5 G T. T/ien /5 o / o a is a lifting of f . 

(4) For any two liftings f and f of f , there is a unique 7 G V , such that 

/' = 7°/- 

Lemma 1 Suppose x G p~ x {x) is a fixed point of lifting f of f , and 7 G V 
is a covering translation on X. Then, a lifting f of f has 7(5) G p^ 1 (x) as 
a fixed point iff f — 7 o / o 7" 1 . 

Proof "If is obvious : f'(j(x)) = 7 o fo 7~ 1 (7(5)) =70/(5) = 7(2;). 
" Only if : Both /' and 70/07' 1 have 7(5) as a fixed point , so they agree 
at the point 7(f). By Proposition 1 they are the same lifting. 

Definition 1 Two liftings f and f of f are said to be conjugate if there 
exists 7 G T, such that f = 7 0/0 7^. Lifting classes are equivalence classes 
by conjugacy. Notation: 

[/] = { 7 o/o 7 - 1 | 7 er} 

Lemma 2 (1) Fix (/) = U / -p(Fix (/)). 

(2) p(Fix (/)) = p(Fix (/')) if [/] = [/']. 

(3) p(Fix (/)) np(Fix (/')) = [/] + [/']. 



Nielsen theory 



22 



Proof (1) If x £ Fix (/), pick x G p _1 (xo). By proposition 1 there 
exists / such that f(xo) = ^o- Hence xo G p(Fix (/)). 

(2) If /' = 7 o / o 7 _1 , then by lemma Fix (/') = 7Fix (/), so p(Fix (/)) = 
p(Fix (/')). 

(3) If Xq G p(Fix (/)) fl p(Fix (/')), there are x ,x' Q G p^ 1 (x ) such that 
Xo G Fix (/) and x' Q G Fix (/'). Suppose x' = 7x0. By lemma , /' = 70 foj" 1 , 
hence [f] = [/']. 

Definition 2 TTie subset p(Fix (/)) o/Fix (/) is called the fixed point class 
of f determined by the lifting class [/]. 

We see that the fixed point set Fix (/) splits into disjoint union of fixed point 
classes. 



Example 2 Let us consider the identity map idx '■ X — > X . Then a lifting 
class is a usual conjugasy class in T;p(Fix (idx)) = X an d p(Fix (7)) = 
otherwise. 



Remark 1 A fixed point class is always considered to carry a label - the 
lifting class determining it . Thus two empty fixed point classes are considered 
different if they are determined by different lifting classes. 

Our definition of a fixed point class is via the universal covering space. It 
essentially says: Two fixed point of / are in the same class iff there is a 
lifting / of / having fixed points above both of them. There is another way 
of saying this, which does not use covering space explicitly, hence is very 
useful in identifying fixed point classes. 

Lemma 3 ( ||51|| ) Two fixed points x and X\ of f belong to the same fixed 
point class iff there is a path c from Xq to x\ such that c = /oc ( homotopy 
relative endpoints). 

Lemma 3 can be considered as an equivalent definition of a non-empty 
fixed point class. Every map / has only finitely many non-empty fixed point 
classes, each a compact subset of X. 
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1.2.1 The influence of a homotopy 

Given a homotopy H = {h t } : fo — fi, we want to see its influence on 
fixed point classes of fo and f\. A homotopy H = {h t } : X X is called 
a lifting of the homotopy H — {h t }, if h t is a lifting of h t for every t G 
/. Given a homotopy and a lifting Jo of /o, there is a unique lifting 
H of H such that /io = fo, hence by unique lifting property of covering 
spaces they determine a lifting f\ of f\. Thus H gives rise to a one-one 
correspondence from liftings of f to liftings of f\. This correspondence 
preserves the conjugacy relation. Thus there is a one-to-one correspondence 
between lifting classes and fixed point classes of f and those of f±. 

1.3 Reidemeister numbers 

1.3.1 Reidemeister numbers of a continuous map 

Definition 3 The number of lifting classes of f (and hence the number of 
fixed point classes, empty or not) is called the Reidemeister number of f , 
denoted by R(f). It is a positive integer or infinity. 

The Reidemeister number R(f) is a homotopy invariant. 

Example 3 If X is simply -connected then R(f) = 1. 

Let / : X — > X be given, and let a specific lifting / : X — > X be chosen 
as reference. Let Y be the group of covering translations of X over X. Then 
every lifting of / can be written uniquely as a o /, with a G T. So elements 
of r serve as coordinates of liftings with respect to the reference /. Now for 
every a G T the composition / o a is a lifting of / so there is a unique a' G T 
such that a' o f = f o a. This correspondence a — > a/ is determined by the 
reference /, and is obviously a homomorphism. 

Definition 4 The endomorphism /* : T — > T determined by the lifting f of 
f is defined by 

/*(«) o/=/oa. 
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It is well known that T = tti(X). We shall identify 7r = 7Ti(X, xq) and 
T in the following way. Pick base points xq G X and xq G p~ 1 (xq) C X 
once and for all. Now points of X are in 1-1 correspondence with homotopy 
classes of paths in X which start at Xq: for x G X take any path in X from 
Xq to x and project it onto X; conversely for a path c starting at Xq, lift it to 
a path in X which starts at xq, and then take its endpoint. In this way, we 
identify a point of X with a path class < c > in X starting from xq- Under 
this identification, x Q =< e > is the unit element in 7Ti(X,xq). The action of 
the loop class a =< a >G tti(X, xq) on X is then given by 

a =< a >:< c >^ a.c =< a.c > . 

Now we have the following relationship between /* : tt — > tt and 

/* : 7Ti(X,X ) — ► 7Ti(X, /(x )). 

Lemma 4 ( ||51|| ) Suppose f(x ) =< w >. Then the following diagram com- 
mutes: 

r 

■Ki(X,x ) 7ri(X,/(x )) 

We have seen that a G 7r can be considered as the coordinate of the lifting 
a o /. Can we tell the conjugacy of two liftings from their coordinates? 

Lemma 5 [a o f] = [a' o /] iff there is 7 G n such that a' = 7a/*(7~ 1 ). 

Proof [a o /] = [a' o /] iff there is 7 G it such that a' o / = 7 o (a o /) o 7 _1 = 

Theorem 3 ( [^1|| ) Lifting classes of f are in 1-1 correspondence with /*- 
conjugacy classes in tt, the lifting class [ao/j corresponds to the f^-cojugacy 
class of a. 

By an abuse of language, we will say that the fixed point class p(Fix (a o 
/)), which is labeled with the lifting class [a o f] , corresponds to the /*- 
conjugacy class of a. Thus the /^-conjugacy classes in n serve as coordinates 
for the fixed point classes of /, once a reference lifting / is chosen. 

A reasonable approach to finding a lower bounds for the Reidemeister 
number, is to consider a homomorphisms from tt sending an /^-conjugacy 
class to one element: 
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Lemma 6 ( ||51|| ) The composition 77 o 9, 

7T = in(X, x ) Hi(X) Coker H X {X) ^ ^(X) 

where 9 is abelianization and r\ is the natural projection, sends every /*- 
conjugacy class to a single element. Moreover, any group homomorphism 
£ : 7i — > G which sends every f^-conjugacy class to a single element, factors 
through n o 9. 

The first part of this lemma is trivial. If a' = 7a/*(7 _1 ) , then 

0(ot) = 0( 7 ) + 0(a) + 0(/.(7 -1 )) = 

= 0( 7 ) + 0(a) - / 1 *(0( T )) = 0(a) + (1 - A,)0( 7 ), 

hence 77 o 0(a) = 77 o 0(a') 

This lemma shows the importance of the group Coker (1 — For 
example 

#(/) > #Coker 

Definition 5 A map f : X — > X is said to be eventually commutative if 
there exists an natural number n such that f£(irx(X,xo)) (c 7Ti(X, f n (xo))) 
is commutative. 

By means of Lemma 4, it is easily seen that / is eventually commutative iff 
/* is eventually commutative (see floTf ) 



Theorem 4 ( [|51|| ) If f is eventually commutative , then 

R(f) = #Coker (l-f u ). 

1.3.2 Reidemeister numbers of a group endomorphism 

Let G be a group and <fi : G — > G an endomorphism. Two elements a, a! G G 
are said to be <p — conjugate iff there exists 7 G G such that a' = 7-a-0(7)~ 1 . 
The number of 0-conjugacy classes is called the Reidemeister number of <p, 
denoted by R{4>). We shall write {g} for the 0-conjugacy class of an element 
g G G. We shall also write TZ(<fi) for the set of 0-conjugacy classes of elements 
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of G. If is the identity map then the 0-conjugacy classes are the usual 
conjugacy classes in the group G. 

An endomorphism : G — > G is said to be eventually commutative if 
there exists a natural number n such that the subgroup <ft n {G) is commuta- 
tive. 

We are now ready to compare the Reidemeister number of an endomor- 
phism (p with the Reidemeister number of Hi(<f>) : H\(G) — > H\(G), where 
Hi = H x p is the first integral homology functor from groups to abelian 
groups. 

Theorem 5 ( [|51|| ) If <fi : G — » G is eventually commutative, then 
R{4>) = R(Hx(<f>)) = #Coker (1 - Hi{4>)). 

This means that to find out about the Reidemeister numbers of eventu- 
ally commutative endomorphisms, it is sufficient to study the Reidemeister 
numbers of endomorphisms of abelian groups. 

From theorem 3 it follows 

Corollary 1 R(f) = R(f*) 

So we see that the homotopy invariant - the Reidemeister number of a con- 
tinuous map is the same as the Reidemeister number of the induced endo- 
morphism /* on the fundamental group. The following are simple but very 
useful facts about 0-conjugacy classes. 

Lemma 7 ( ||51|| ) If G is a group and is an endomorphism of G then an 
element x G G is always (^-conjugate to its image <ft(x). 

Proof If g = x~ l then one has immediately gx = 4>{x)<f>(g). The existence 
of a g satisfying this equation implies that x and <p(x) are 0-conjugate. 

1.4 Nielsen numbers of a continuous map 
1.4.1 The fixed point index 



The fixed point index provides an algebraic count of fixed points. We will 
introduce step-by-step construction of the index, and list without proof the 
most useful properties. The reader may consult the book of Dold . 
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(A) THE INDEX OF AN ISOLATED FIXED POINT IN R n . 

f 

Suppose R n D U — ► R n , and a e U is an isolated fixed point of /.Pick 
a sphere S^™ -1 centered at a, small enough to exclude other fixed points. On 
Sa 11 - 1 , the vector x - f{x) ^ 0, so a direction field 

is defined. 

Definition 6 Index (f,a)— degree of (p 



Example 4 If f is a constant map to the point a, then Index (/, a) = 1 



Example 5 Suppose f is differentiable at a with Jacobian A = {-^) a , an d 
det(J — A) ^ 0. Then a is an isolated fixed point and 

Index (/, a) = sign det(J - A) = (-l) k , 

where k is the number (counted with multiplicity) of real eigenvalues of A 
greater than 1. 

(B) FIXED POINT INDEX IN R n . 

Definition 7 Suppose R n D U — ► R n , and Fix(f) is compact. Take any 
open set V C U such that Fix (/) C V C V C U and V is a smooth n- 
manifold, then <f>(dV) = i ■ S^ 1 in the homological sense for some i 6 1. 
This i is independent of the choice of V , and is defined to be the fixed point 
index of f on U , denoted Index (/, U). 

Another way of defining Index (/, U) is by approximation, namely, approxi- 
mate / by a smooth map with only generic fixed points( isolated fixed points 
satisfying the condition in example 5 ), and add up their indices. 

(C) FIXED POINT INDEX FOR POLYHEDRA. 

Every compact polyhedron can be embedded in some Euclidean space as 
a neighborhood retract. Suppose now we are given a compact polyhedron 
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X, and a map X D U X. X can be imbedded in R N with inclusion 
X — > i?^. And there is a neighborhood of i(X) in i?^ and a retraction 
— X such that r o i = id X - We have a diagram 

X DC/ X 
T r 1 r I i . 

R N DW D r- 1 ^) ^ R N 

Definition 8 When Fix(f) is compact, define the fixed point index to be 

Index (/, U) := Index (iofor, r~ (U)), 

the later being the index in R N . It is independent of the choice of N,W,i 
and r. 

All the facts we need about the fixed point index are listed below. 

(I) Existence of fixed points. If Index (/, U) ^ 0, then / has at least one 
fixed point in U. 

(II) Homotopy invariance. If H = {h t } : f ~ fx : U —>■ X is a homotopy 
such that U te /Fix (h t ) is compact, then 

Index (f ,U) = Index (f\,U). 

(III) Additivity. Suppose U±, U s are disjoint open subsets of U, and / 
has no fixed points on U—Uj =1 Uj. If Index (/, U) is defined, then Index (/, Uj). 
j = 1, s are all defined and 

Index (f,U) = £ Index U^)- 

3=1 

(IV) Normalization. If / : X -»• X , then 

dim X 

Index (f,X) = L(f) := £ (-l) fc Tr [f* k : H k {X;Q) -> H k (X;Q) 

k=0 

where L(f) is the Lefschetz number of /. 

Lemma 8 ( ||51|| ) (Homotopy invariance) Let X be a connected, compact 
polyhedron, H = {h t } : fo ~ f\ : X — + X fre a homotopy, and Fi be a 
fixed point class of fi,i — 0,1. If Fq corresponds to F\ via H, then 

Index {f ,F ) = Index (f^F,) 
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1.4.2 Nielsen numbers 

Definition 9 A fixed point class is called essential if its index is nonzero. The 
number of essential fixed point classes is called the Nielsen number of f , de- 
noted by N(f). 

The next lemma follows directly from the definitions and the properties of 
the index. 

Lemma 9 (1) N(f) < R(f). 

(2) Each essential fixed point class is non-empty. 

(3) N(f) is non-negative integer, < N(f) < oo. 

(4) N(f)<#Fht(f). 

(5) The sum of the indices of all essential fixed point classes of f equals 
to the Lefschetz number L(f). Hence L(f) ^ implies N(f) > 1. 



Example 6 



at/* t \ f 1 if Euler characteristic y(X) ^ 0, 
N{tdx) = I if X (X) = 



Lemma 10 N(f) is a homotopy invariant of f . Every map homotopic to f 
has at least N(f) fixed points. In other words, N(f) < Min{#Fix(g)\g ~ 

/}• 

It is this lemma that made the Nielsen number so important in fixed point 
theory. Lemma tells us that an essential fixed point class can never disappear 
(i.e. become empty) via a homotopy. 

Two maps / : X — > X and g : Y — > Y are said to be of the same 
homotopy type if there is a homotopy equivalence h : X — > Y such that 
ho f ~ g oh. 

Theorem 6 ( Homotopy type invariance of the Nielsen number). If 

X, Y are compact connected polyhedra, and f : X — > X and g : Y —>Y are 
of the same homotopy type, then N(f) = N(g). 
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1.4.3 The least number of fixed points 

Let X be a compact connected polyhedron , and let / : X — > X be a map. 
Consider the number 

MF[f] :=Mm{#Fix (g)\g~f}, 

i.e. the least number of fixed points in the homotopy class [/] of /. We 
know that N(f) is a lower bound for MF[f]. The importance of the Nielsen 
number in the fixed point theory lies in the fact that, under a mild restriction 
on the space involved , it is indeed the minimal number of fixed points in the 
homotopy class. The equality MF[f] = N(f) means that we can homotope 
the map / so that each essential fixed point class is combined into a single 
fixed point and each inessential fixed point class is removed. 

Definition 10 A point x of a connected space X is a (global) separating 
point of X if X — x is not connected. A point x of a space X is a local 
separating point if x is a separating point of some connected open subspace 
UofX. 



Theorem 7 ( [|51|| ) Let X be a compact connected polyhedron without local 
separating points. Suppose X is not a surface (closed or with boundary) of 
negative Euler characteristic. Then MF[f] = N(f) for any map f : X — * X . 



This theorem is generalization of the classical theorem of Wecken |97] for 
manifolds of dimension > 3. 



Lemma 11 (|]51|j) (Geometric characterization of the Nielsen number). In 



the category of compact connected polyhedra, the Nielsen number of a self- 
map equals the least number of fixed points among all self-maps having the 
same homotopy type. 

Proof Let / : X — > X be a self -map in the category , and consider the 
number m = Min{#Fix (g)\g has the same homotopy type as /}. 

Then N(f) < m by lemma 9 and theorem 6 . On the other hand , there 
always exists a manifold M (with boundary) of dimension > 3 which has the 
same homotopy type as X ( for example , M— the regular neighborhood of 
X imbedded in a Euclidean space). So , by the theorem 7, the lower bound 
N(f) is realizable on M by a map having the same homotopy type as /. 



Chapter 2 

The Reidemeister zeta function 



PROBLEM. For which groups and endomorphisms is the 
Reidemeister zeta function a rational function? When does it 
have a functional equation? Is R^,{z) an algebraic function? 



2.1 A Convolution Product 

When R(f,(z) is a rational function the infinite sequence {R((f) n )}^ =1 of Rei- 
demeister numbers is determined by a finite set of complex numbers - the 
zeros and poles of R<f>(z). 

Lemma 12 R<f,(z) is a rational function if and only if there exists a finite 
set of complex numbers oti and f3j such that R{4> n ) = J2j Pj 1 ~ Hi a ? f or every 
n>0. 

Proof Suppose R<j>(z) is a rational function. Then 

n t (l -ajz) 

Mz) ~ n,(i-ftz)' 

where aj,/3j G (U. Taking the logarithmic derivative of both sides and then 
using the geometric series expansion we see that R(4> n ) = J2j Pj — J2i a i- 
The converse is proved by a direct calculation. 

For two sequences (x n ) and (y n ) we may define the corresponding zeta 
functions: 

X(z) := exp f f , 

\n=l n J 



31 
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Y(z) : = exp £ 



Un n 



Z 



n=l H 



Alternately, given complex functions X and Y (defined in a neighborhood of 
0) we may define sequences 

d n 



d 



n 



z=0 



dz r 

Taking the componentwise product of the two sequences gives another se- 
quence, from which we obtain another complex function. We call this new 
function the additive convolution of X and Y, and we write it 



/ oo 

(X*Y)(z) :=exp ]T : 



Kn=l U 



It follows immediately from lemma 1 that if X and Y are rational functions 
then X*Y is a rational function. In fact we may show using the same method 
the following 

Lemma 13 (Convolution of rational functions) Let 

x(z) = n(i - M m « y(z) = n(i - M i{3) 

i j 

be rational functions in z. Then X *Y is the following rational function 

(X*Y)(z) = H(l-a t f3 3 z)- m ^. (2.1) 

A consequence of this is the following 

Lemma 14 (Functional equation of a convolution) LetX(z) andY(z) 
be rational functions satisfying the following functional equations 
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with di e (U* , ei e ,Ki £ (D* and f { G {1, -1}. Suppose also that X(0) = 
Y(0) = 1. Then the rational function X * Y has the following functional 
equation: 

(X * Y) (-r-r-) = K 3 z~ eie2 (X * Y) (z) hh (2.2) 



d\d2Z 



for some K 3 G W* . 



PROOF The functions X and Y have representations of the following 
form: 

X(z) = - M mW , Y(z) = 11(1- (3 3 zf >\ 

i=l j=l 

The functional equation for X means that if zq G W* is a zero or pole of X 
with multiplicity to, then must be a pole or zero of X with multiplicity 
/ito. We therefore have a map 

i i — > 

defined by the equation 

1 

a, 



d\Ctii 

and with the property that 

m(i) = f\m{i'). 

Similarly there is a map j \— > j' with corresponding properties: 

pj = d^~r 

Kj) = f2l(f). 

Putting these maps together, we obtain a map of pairs 
with the following properties 
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m (i) l 0) = hf2m(i')l{j'). 

It follows from the previous lemma that the functions (X * Y)(z) and (X * 
Y){-^^Y 1 ^ have the same zeros and poles in the domain (D* . Since both 
functions are rational, we deduce that X *Y has a functional equation of the 
form 

(X*Y) =K 3 z- e3 (X*Y)( Z y^, 

for some e 3 G 2£ '. It remains only to show that e 3 = eie2- 

By comparing the degrees at zero of the functions X(z) and X(-^) we 
obtain from the functional equation for X: 

a 

ei = £m(i). 
i=i 

Similarly we have 

e 2 = E/(j)- 

For the same reasons we have 

e 3 = ^m(i)I(j) 

= (E "»(<)) (E'O')) 

i=l j=l 

= eie 2 . 



2.2 Pontryagin Duality 

Let G be a locally compact Abelian topological group. We write G for the set 
of continuous homomorphisms from G to the circle U(l) = {z G (0 : |z| = 1}. 
This is a group with pointwise multiplication. We call G the Pontryagin dual 
of C When we equip G with the compact-open topology it becomes a locally 
compact Abelian topological group. The dual of the dual of G is canonically 
isomorphic to G. 

A continuous endomorphism / : G — > G gives rise to a continuous endo- 
morphism / : G — > G defined by 

/(x) -=X° f- 
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There is a 1-1 correspondence between the closed subgroups H of G and the 
quotient groups G/H* of G for which H* is closed in G. This correspondence 
is given by the following: 

H <-> G/H*, 

H* := { X eG\H Cker X }. 

Under this correspondence, G/H* is canonically isomorphic to the Pontryagin 
dual of H . If we identify G canonically with the dual of G then we have 
H** = H. 

If G is a finitely generated free Abelian group then a homomorphism 
X '■ G — > U(l) is completely determined by its values on a basis of G, and 
these values may be chosen arbitrarily. The dual of G is thus a torus whose 
dimension is equal to the rank of G. 

If G = Zj/nZi then the elements of G are of the form 

2iriyx 

x — > e~^~ 

with y G {1, 2, ... , n}. A cyclic group is therefore (uncanonically) isomorphic 
to itself. 

The dual of G\ © G2 is canonically isomorphic to G\@G2- From this we 
see that any finite abelian group is (non-canonically) isomorphic to its own 
Pontryagin dual group, and that the dual of any finitely generated discrete 
Abelian group is the direct sum of a Torus and a finite group. 

Proofs of all these statements may be found, for example in |8T] . We shall 
require the following statement: 

Proposition 2 Let <fi : G — » G be an endomorphism of an Abelian group G. 



Then the kernel ker 
dual of Coker 0. 



: G -> G 



is canonically isomorphic to the Pontryagin 



Proof We construct the isomorphism explicitly. Let x De i n the dual of 
Coker (0 : G — > G). In that case X is a homomorphism 

X ■ G/Im (0) — U(l). 

There is therefore an induced map 

X-G^U{1) 
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which is trivial on Im ((f)). This means that x ° is trivial, or in other words 
(f>(x) is the identity element of G. We therefore have x G ker(0). 

If on the other hand we begin with x G ker(0), then it follows that x is 
trivial on Im 0, and so x induces a homomorphism 

X ■ G/lm (0) — 17(1) 

and x is then in the dual of Coker 0. The correspondence x ^ X is clearly 
a bijection. 

2.3 Eventually commutative endomorphisms 

An endomorphism : G — > G is said to be eventually commutative if there 
exists a natural number n such that the subgroup (f> n (G) is commutative. 

2.3.1 Trace formula for the Reidemeister numbers of 
eventually commutative endomorphisms 

We know from theorem 5 in Chapter 1 that if : G — > G is eventually 
commutative, then 

i?(0) = i?(#i(0)) = #Coker (1 - #!(0)) 

This means that to find out about the Reidemeister numbers of eventu- 
ally commutative endomorphisms, it is sufficient to study the Reidemeister 
numbers of endomorphisms of abelian groups. For the rest of this section G 
will be a finitely generated abelian group. 

Lemma 15 Let : ZZ k — > % k be a group endomorphism. Then we have 

k 

R{4>) = (-ir + ^(-lfTr (AV). (2.3) 

i=Q 

where p the number of /j, G Spec such that ji < — 1, and r the number of 
real eigenvalues of whose absolute value is > 1. A 1 denotes the exterior 
power. 
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Proof Since *%j k is Abelian, we have as before, 



#Coker (1-0). 



On the other hand we have 



#Coker (1 



0) =| det(l -0) 



and hence R((f>) = (— l) r+p det(l — 0) ( complex eigenvalues contribute noth- 
ing to the signdet(l — 0) since they come in conjugate pairs and (1 — A) (1 — 
A) =| 1 — A | 2 > 0). It is well known from linear algebra that det(l — 0) = 

Ei (- i ) iTr ( A >)- Fr ° m this 

we have the trace formula for Reidemeister 

number. 

Now let be an endomorphism of finite Abelian group G.Let V be the 
complex vector space of complex valued functions on the group G.The map 
induces a linear map A : V — > V defined by 



Lemma 16 Let : G — > G be an endomorphism of a finite Abelian group 
G. Then we have 



We give two proofs of this lemma . The first proof is given here and the 
second proof is a special case of the proof of theorem 15 

Proof The characteristic functions of the elements of G form a basis 
of V,and are mapped to one another by A(the map need not be a bijec- 
tion). Therefore the trace of A is the number of elements of this basis which 
are fixed by A. On the other hand, since G is Abelian, we have, 



A(f) :=/o0. 



R(<j>) = TrA 



(2.4) 



R{4>) 



#Coker (1 - 0) 

#G/#Im(l-0) 

#G/#(G/ker(l-0)) 

#G/(#G/#ker(l-0)) 

#ker(l-0) 

#Fix (0) 



Reidemeister zeta function 



38 



We therefore have R((f>) = #Fix (0) = Tr A . 

For a finitely generated Abelian group G we define the finite subgroup 
Qfimte ^ Q gubgrQup Q f torsion elements of G. We denote the quotient 

G°° := G/G^ mite . The group G°° is torsion free. Since the image of any 
torsion element by a homomorphism must be a torsion element, the endo- 
morphism : G — > G induces endomorphisms 

^finite . ^/finite ^ q finite ^oo . ^ G°° 

As above, the map <j)f inite induces a linear map A : V — > V, where F be 
the complex vector space of complex valued functions on the group 

Theorem 8 If G is a finitely generated Abelian group and an endomor- 
phism of G . Then we have 

k 

#(0) = (-iy+p ^(-l)*Tr (A>°° ® A). (2.5) 

i=0 

where k is rgG°° , p the number of /i e Spec 0°° snc/i i/ioi /x < —1, and r £/ie 
number of real eigenvalues of 0°° whose absolute value is > 1. 

Proof By proposition 2, the cokernel of (1—0) : G — > G is the Pontrjagin 
dual of the kernel of the dual map (1 — 0) : G — > G. Since Coker (1 — 0) is 
finite, we have 

#Coker (1 - 0) = #ker (1^0). 

The map 1 — is equal to 1 — 0. Its kernel is thus the set of fixed points of 
the map : G — > G. We therefore have 

R(<f)) = #Fix (0 : G -> G) (2.6) 

The dual group of G°° is a torus whose dimension is the rank of G. This 
is canonically a closed subgroup of G. We shall denote it G . The quotient 
G/Go is canonically isomorphic to the dual of Qf mite , It is therefore finite. 
From this we know that G is a union of finitely many disjoint tori. We shall 
call these tori G , . . . , G t . 

We shall call a torus Gj periodic if there is an iteration s such that 
4> s (Gi) C Gj. If this is the case, then the map s : Gj — > Gj is a translation 
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of the map s : Go — > Go and has the same number of fixed points as this 
map. If <j) s (Gi) (jL Gi then s has no fixed points in Gj. From this we see 



#Fix (0 : G -> G) = #Fix (0 : G -> G ) x #{G, | 0(G,) c G,}. 



We now rephrase this 



#Fix (0 : G -> G) 
= #Fix (0^ : G ^ G ) x #Fix (0& : G/(G ) - G/(G )) . 



From this we have product formula for Reidemeister numbers 



R((j)) = ■ R((j)f inite ). 



The trace formula for R((f>) follow from the previous two lemmas and formula 



2.3.2 Rationality of Reidemeister zeta functions of even- 
tually commutative endomorphisms - first proof. 

If we compare the Reidemeister zeta function of an endomorphism with 
the Reidemeister zeta function of i?i(0) : Hi(G) — > Hi(G), where Hi = H 1 P 
is the first integral homology functor from groups to abelian groups, then we 
have from theorem 5 in chapter 1 following 

Theorem 9 If : G — > G is eventually commutative, then 



This means that to find out about the Reidemeister zeta functions of 
eventually commutative endomorphisms, it is sufficient to study the zeta 
functions of endomorphisms of Abelian groups. 

Lemma 17 Let : ZZ k — > % k be a group endomorphism. Then we have 



where a = (— l) p with p the number of fi G Spec such that fj, < —1, and r 
the number of real eigenvalues of whose absolute value is > 1. A* denotes 
the exterior power. 



Tr (A>°°) • Tr (A) = Tr (A>°° <g> A). 





(2.7) 
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Proof Since ^ is Abelian, we have as before, 

R((f) n ) = #Coker (1-0"). 

On the other hand we have 

#Coker (1 - 0") =| det(l - <f) |, 

and hence R{<p n ) = (— l) r+pn det(l — n ). It is well known from linear algebra 
that det(l-0 n ) = Ef=o( _ l) i T r (A*0 n ). From this we have the following trace 
formula for Reidemeister numbers: 

k 

R((j) n ) = (-l) r +P n ^(-l)TY (A> n ). (2.8) 

i=0 

We now calculate directly 

R4z) = exp 



II exp E -Tr (A>") • (<7*) B 

i=0 V \n=l 71 



= ^ndet(l-AV-^) ( 1)1+1 j 



Lemma 18 Lei <p : G ^ G be an endomorphism of a finite Abelian group 
G. Then we have 

[7] 

where the product is taken over the periodic orbits of <fi in G. 

We give two proofs of this lemma. The first proof is given here and the 
second proof is a special case of the proof of theorem 16 . 
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Proof Since G is Abelian, we again have, 

R((f) n ) = #Coker (1 - <f) 
= #G/#Im(l-0") 
= #G/#(G/ker(l-<T)) 
= #G/(#G/#ker(l-0")) 
= #ker(l-0 n ) 
= #Fix(0") 

We shall call an element of G periodic if it is fixed by some iteration of 0. A 
periodic element 7 is fixed by <f) n iff n is divisible by the cardinality the orbit 
of 7. We therefore have 

R(r) = E 1 

7 periodic 
#MI™ 

= E #M- 

[7] such that, 



From this follows 



it^) = expff^V 



vn=l n 



cxp 



n=l n 



V [7] , 



II cxp #bU - 



[7] 



vn=!#[7]n 



#[ 7 ]n 



= IT ex p E-* : 

[ 7 ] \n=l / 

= n^pi-^si 1 -^* 171 )) 

hi 

[7] 

For a finitely generated Abelian group G we define the finite subgroup 
q finite ^ e ^h e subgroup of torsion elements of G. We denote the quotient 
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G°° := G/G^ mzte . The group G°° is torsion free. Since the image of any 
torsion element by a homomorphism must be a torsion element, the function 
: G — > G induces maps 

inite . ^finite ^ finite 100 . ^ G°° 



Theorem 10 If G is a finitely generated Abelian group and an endomor- 
phism of G then R^(z) is a rational function and is equal to the following 
additive convolution: 

R 4> (z) = R~(z)*R f ; nUe (z). (2.10) 

where R™(z) is the Reidemeister zeta function of the endomorphism 0°° : 
G°° — > G°° , and R^ nite (z) is the Reidemeister zeta function of the endomor- 
phism <f) finite : G finite -> G finite . The functions Rf{z) and R f / nite (z) are 
given by the formulae 

(— i) r 

R?w = (n det ( x - A >°° • °- • , (2.H) 

\i=0 / 



^n^n^- ( 2 - 12 ) 

hi 

w?£/i £/ie product in (2.12) being taken over all periodic <p-orbits of torsion 
elements 7 G G. Also, a = (— l) p where p is the number of real eingevalues 
A G Spec 0°° snc/i £/ia£ A < — 1 and r £/ie number of real eingevalues 
A G Spec 0°° snc/i i/ia£ | A |> 1. 

PROOF By proposition 2, the cokernel of (1 — 0™) : G — > G is the Pontrja- 
gin dual of the kernel of the dual map (1 — 0") : G — > G. Since Coker (1 — 0™) 
is finite, we have 

#Coker (1 - n ) = #ker (1 ^0"). 

The map 1 — 0™ is equal to i — n . Its kernel is thus the set of fixed points 
of the map 0™ : G — > G. We therefore have 

i?(0") = #Fix (0™ : G -> G) - 1 (2.13) 



1 We shall use this formula again later to connect the Reidemeister number of (f> with 
the Lefschctz number of <b. 
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The dual group of G°° is a torus whose dimension is the rank of G. This 
is canonically a closed subgroup of G. We shall denote it Gq. The quotient 
G/Gq is canonically isomorphic to the dual of G^ mte . It is therefore finite. 
From this we know that G is a union of finitely many disjoint tori. We shall 
call these tori G , . . . , G r . 

We shall call a torus Gj periodic if there is an iteration s such that 
4> s {Gi) C Gi. If this is the case, then the map <p s : Gi — > Gi is a translation 
of the map s : G — > G and has the same number of fixed points as this 
map. If 4> s (Gi) <f_ Gi then s has no fixed points in Gj. From this we see 

#Fix (f :G^G)= #Fix (f : G - G ) x | 0"(G,) c Gi}. 

We now rephrase this 

#Fix (f 1 : G -> G) 

= #Fix (0^" : Go -> Go) x #Fix (^& n : G/(G ) -> G/(G )) . 

From this we have that R((f) n ) = i?((0°°) n ) • R{{<f) finite ) n ) for every n and 

The rationality of R<f,(z) and the formulae for R™(z) and R^ mite (z) follow 
from the previous two lemmas and lemma 13. 

Corollary 2 Let the assumptions of theorem 10 hold. Then the poles and 
zeros of the Reidemeister zeta function are complex numbers of the form ( a b 
where b is the reciprocal of an eigenvalue of one of the matrices 

A l (0°°) : A\G°°) — ► A l (G°°) < i < rank G 

and ( a is a ip th root of unity where ip is the number of periodic torsion el- 
ements in G. The multiplicities of the roots or poles ( a b and ( a b' are the 
same if b = b' and hcf(a,tp) = hcf(a',ip). 

2.3.3 Functional equation for the Reidemeister zeta 
function of an eventually commutative endomor- 
phism 



Reidemeister zeta function 



44 



Lemma 19 (Functional equation for the torsion free part) 

Let (ft : % k — > be an endomorphism. The Reidemeister zeta function 
R<p(z) has the following functional equation: 



Rd 



X -) = ■ R,(z)^ k . (2.14) 



Az 

where d = det <p and e\ are a constants in (F* . 

Proof Via the natural nonsingular pairing (JV/Z k ) <g> (A k ~ l % k ) — > Wthe 
operators A k ~ l <f) and d ■ (A*0) _1 are adjoint to each other. 

We consider an eigenvalue A of A l <j). By lemma 17, this contributes a 

term ((1 — to R^ (^)- We rewrite this term as 

and note that | is an eigenvalue of A fc_i 0. Multiplying these terms together 
we obtain, 

The variable z has disappeared because 

k k 

J2{-iy dimA^ fc = ^(-1)* • CI = 0. 

i=0 i=0 



Lemma 20 (Functional equation for the finite part) Let <fi : G — > G 

fre an endomorphism of a finite, Abelian group G. The Reidemeister zeta 
function R^z) has the following functional equation: 

R f (l) = ( 2 - 15 ) 

where q is the number of periodic elements of in G and p is the number of 
periodic orbits of (p in G. 
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Proof This is a simple calculation. We begin with formula (2.9). 

n— 

[7] 

n 



Ra, ( — 



[7] 

Z #M _ 1 

[7] 



[7] 

,#[7] 



[7] [7] 

= n-* #[7] *^(*)- 

[7] 

The statement now follows because X)[ 7 ] #[7] = 

Theorem 11 (Functional equation) Let : G — > G be an endomorphism 
of a finitely generated Abelian group G. If G is finite the functional equation 
of is described in lemma 20. If G is infinite then has the following 
functional equation: 

R, {£) = e 2 ■ R^r 1 ^ ° ■ (2-16) 
where d = det (0°° : G°° — > G°°) and e 2 are a constants in (D* . 

Proof From theorem 10 we have R^z) = R™{z) * R f J nite (z). In the 
previous two lemmas we have obtained functional equations for the functions 
Rf(z) and R% nite {z). Lemma 14 now gives the functional equation for R^(z). 

2.3 A Rationality of Reidemeister zeta functions of even- 
tually commutative endomorphisms - second proof. 

Theorem 12 Let G is a finitely generated Abelian group and an endomor- 
phism of G .Then R<f,(z) is a rational function and is equal to 

( k \ { ~ ir 

R^z) = |JT_ det(l - A>°° <g> A ■ a ■ z)^ +1 j (2.17) 



Reidemeister zeta function 



46 



where matrix A is defined in lemma 16 , o = (— l) p , p , r and k are constants 
described in theorem 8 . 

Proof If we repeat the proof of the theorem 8 for <p n instead <fi we obtain 
that R((j) n ) = R((i°°) n ) ■ R(((f) finite ) n ).From this and lemmas 15 and 16 we 
have the trace formula for R((f) n ): 



R((f) n ) = (-l) r+ P n ^(-l) i Tr A l (0°°) n -Tr A n 

i=0 
k 

= (-iy+p n ^(-i)*Tr (A*(0°°) n <g> A n ) 

i=0 
k 

= (-iy+p n ^(-i)nY (A>°° <g> A) n . 



i=0 



We now calculate directly 
R^z) = expff^V 



Kn=l U 



exp ( ~ ir gkizlg ( A >°° g A )" (j . z y 



co 1 \\ (-D*N 



n ex p e - Tr ( a >°° ® a t ■ ( a ■ z ) n 

i=0 V \n=l n 

* , N (-!) T 



= (j[det(l-A i (f)° ®A-a-z) { 1)t+ ^ 



Corollary 3 Let t/ie assumptions of theorem 12 hold. Then the poles and 
zeros of the Reidemeister zeta function are complex numbers which are the 
reciprocal of an eigenvalues of one of the matrices 

K l {(j)°°) ®A-a < i < rank G 

2.3.5 Connection of the Reidemeister zeta function with 
the Lefschetz zeta function of the dual map 
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Theorem 13 (Connection with Lefschetz numbers) Let (ft : G — > G be 

an endomorphism of a finitely generated Abelian group. Then we have the 
following 

R((ft n ) =| L(r) |, (2.18) 

where (ft is the continuous endomorphism of G defined in section 2.2 and 
L((ft n ) is the Lefschetz number of (ft thought of as a self-map of the topological 
space G. From this it follows: 

R*{z) = L^az)^, (2.19) 

where r and a are the constants described in theorem 10. If G is finite then 
this reduces to 

R((ft n ) = L(4> n ) and R^z) = L^z). 

The proof is similar to that of Anosov Q concerning continuous maps of 
nil-manifolds. 

Proof We already know from formula (2.13) in the proof of theorem 10 
that R((ft n ) is the number of fixed points of the map <ft n . If G is finite then G 
is a discrete finite set, so the number of fixed points is equal to the Lefschetz 
number. This finishes the proof in the case that G is finite. In general it is 
only necessary to check that the number of fixed points of (ft n is equal to the 
absolute value of its Lefschetz number. We assume without loss of generality 
that n = 1. We are assuming that R(<ft) is finite, so the fixed points of (ft 
form a discrete set. We therefore have 

L{4>) = X! Index ((ft, x). 

Since (ft is a group endomorphism, the zero element G G is always fixed. 
Let x be any fixed point of (ft. We then have a commutative diagram 

9 G G g 

II II 
g + x G G g + x 

in which the vertical functions are translations on G by x. Since the vertical 
maps map to x, we deduce that 

Index ((ft, x) = Index ((ft, 0) 
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and so all fixed points have the same index. It is now sufficient to show that 
Index (<f), 0) = ±1. This follows because the map on the torus 

i ■ Go - G 

lifts to a linear map of the universal cover, which is in this case the Lie 
algebra of G. The index is then the sign of the determinant of the identity 
map minus this lifted map. This determinant cannot be zero, because 1 — 
must have finite kernel by our assumption that the Reidemeister number of 
is finite (if det(l — 0) = then the kernel of 1 — is a positive dimensional 
subgroup of G, and therefore infinite). 

2.4 Endomorphisms of finite groups 

In this section we consider finite non-Abelian groups. We shall write the 
group law multiplicatively. We generalize our results on endomorphisms of 
finite Abelian groups to endomorphisms of finite non-Abelian groups. We 
shall write {g} for the 0-conjugacy class of an element g G G. We shall 
write < g > for the ordinary conjugacy class of g in G. We continue to 
write [g] for the 0-orbit of g G G, and we also write now [< g >] for the 
0-orbit of the ordinary conjugacy class of g G G. We first note that if is an 
endomorphism of a group G then maps conjugate elements to conjugate 
elements. It therefore induces an endomorphism of the set of conjugacy 
classes of elements of G. If G is Abelian then a conjugacy class consists of a 
single element. The following is thus an extension of lemma 16: 

Theorem 14 Let G be a finite group and let : G — > G be an endomor- 
phism. Then R(</>) is the number of ordinary conjugacy classes < x > in G 
such that < (f>(x) >=< x >. 

Proof From the definition of the Reidemeister number we have, 

m = E 1 

{<?} 

where {g} runs through the set of 0-conjugacy classes in G. This gives us 
immediately 

m = £ E ^-r 
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= T — 

We now calculate for any x G G the order of {x}. The class {x} is the orbit 
of x under the G-action 

(g,x) i — ► gxftg)' 1 . 
We verify that this is actually a G-action: 

(id,x) i — > id.x.^id) -1 

= x, 

{9x92, x) i — > gm-x.^g^)' 1 

= 9i92-x.((j)(gi)(j)(g2)y 1 

= gig2-x4(g 2 y 1 (t){giY 1 

= gi^-x.^T^igiT 1 - 

We therefore have from the orbit-stabilizer theorem, 

#G 



#{*} 



#{<? E G | gxfiig)- 1 = x} 
The condition gx(p(g)~ l = x is equivalent to 

x' 1 gx^g)' 1 = 1 <^> aT^rr = 0(g>) 

We therefore have 

= ^ £ e G | x- l gx = <f>(g)}. 
Changing the summation over x to summation over g, we have: 

R M = ^E#i^ G I = 4(g)}. 
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If < <f>(g) >t^< g > then there are no elements x such that x 1 gx = (f)(g). 
We therefore have: 

R ^ = ^T E #{xeG\x- 1 gx = <f ) (g)}. 

TT^ geG such that 
<0( 9 )> = <9> 

The elements x such that x~ 1 gx = <p{g) form a coset of the subgroup satis- 
fying x~ x gx = g. This subgroup is the centralizer of g in G which we write 
C(g). With this notation we have, 

R(<l>) = ^ E #C{g) 

II geG such that 

<<P(g)>=<9> 

= 4^ E #<9>-#C(g). 

TT*- 7 <g>CG such that 

«P(g)>=<g> 

The last identity follows because C(h~ 1 gh) = h~ 1 C(g)h. From the orbit 
stabilizer theorem, we know that # < g > .#C(g) = #G. We therefore have 

R(<t>) = #{< 9>cG|< (t>{g) >=< g >}• 



Let W be the complex vector space of complex valued class functions on 
the group G.A class function is a function which takes the same value on 
every element of a usual congruency class. The map <f> induces a linear map 
B : W -> W defined by 

£(/):= /o0. 

Theorem 15 (Trace formula) Let <fi : G ^ G be an endomorphism of a 
finite group G. Then we have 

R{4>) = Tr B (2.20) 

PROOF The characteristic functions of the congruency classes in G form 
a basis of W, and are mapped to one another by B (the map need not be 
a bijection). Therefore the trace of B is the number of elements of this basis 
which are fixed by B. By theorem 14, this is equal to the Reidemeister 
number of 4>. 

From the theorem 14 we have immediately, 
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Theorem 16 Let <p be an endomorphism of a finite group G. Then R^z) 
is a rational function with a functional equation. In particular we have, 



R+w = n 



i 



[<<?>] 



1 _ z #[<9>] ' 



ft, ( — 

.Z 



(-l)V^(z). 



The product here is over all periodic (p-orbits of ordinary conjugacy classes 
of elements of G. The number #[< g >] is the number of conjugacy classes 
in the 4>- orbit of the conjugacy class < g >. In the functional equation the 
numbers a and b are respectively the number of periodic <p-orbits of conjugacy 
classes of elements of G and the number of periodic conjugacy classes of 
elements of G. A conjugacy class < g > is called periodic if for some n > 0, 
< <f) n (g) >=< g > 

PROOF From the theorem 14 we know that R(<f) n ) is the number of con- 



jugacy classes < g >C G such that 
this 

R(r) = e 

[<<?>] such that 
#[< 9>]\n 

From this we have, 

/ 



< g >) C< g >. We can rewrite 
#[<<?>]■ 



RAz) 



n ex p 

[<<?>] 



E 

1 such that 
^ #[< g>]\n 



#[< 9 >] 



n 



n 



J 



The first formula now follows by using the power series expansion for log(l — 
z). The functional equation follows now in exactly the same way as lemma 
20 follows from lemma 18. 

Corollary 4 Suppose that <pi and <p 2 are two endomorphisms of a finite 
group G with 

\/ g eG, Mg) = hUg)h- 1 

for some fixed element h e G. Then R^z) = R^ 2 (z). 
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Corollary 5 Let <f> be an inner automorphism. Then 

RJz) 



[l-zf 



where b is the number of conjugacy classes of elements in the group. In 
particular, all but finitely many of the symmetric and alternating groups have 
the property that any automorphism is an inner automorphism, and so this 
corollary applies. 



Remark 2 // we think of the set of conjugacy classes of elements of G as 
a discrete set then the Reidemeister number of <fi is equal to the Lefschetz 
number of the induced map on the set of the conjugacy classes of elements of 
G. 

Another proof of rationality of the Reidemeister zeta function for finite 
groups follows from the trace formula for the Reidemeister numbers in the 
theorem 15. 

Theorem 17 Let <fi be an endomorphism of a finite group G. Then R^(z) 
is a rational function and given by formula 

R ^ = soW (2 ' 21) 

Where B is defined in theorem 15 

Proof From theorem 15 it follows that R((f) n ) = Tr B n for every n > 
o.We now calculate directly 

= exp(Tr (-log(l - Bz))) = 



det(l - Bz) 
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2.5 Endomorphisms of the direct sum of a 
free Abelian and a finite group 

In this section let F be a finite group and r a natural number. The group G 
will be 

G = % r © F 

We shall describe the Reidemeister numbers of endomorphism : G — > G. 
The torsion elements of G are exactly the elements of the finite, normal 
subgroup F. For this reason we have 0(F) C F.Let (f>* mite ; F — > F be the 
restriction of to F, and let 0°° : G/F — > G/F be the induced map on the 
quotient group. 

Let pr%r : G — > and pr> : G — > F be the projections onto 2Z, r and F 
. Then the composition 

pr%r o : .ZT — > G — > -ZT 

is an endomorphism of -ZT, which is given by some matrix M G M r (2Z). We 
denote by -0 : -ZT — > F the other component of the restriction of to Z r , 
i.e. 

i>(v) = pr F ((f)(v)). 
We therefore have for any element (v, f) G G 

<P(v,f) = (M-v^(v)<j ) (f)). 

Lemma 21 Let g\ = (i>i,/i) and #2 = (^2, f'2) be two elements of G. Then 
gi and g 2 are ^-conjugate iff 

v x = v 2 mod (1 - M)% r 

and there is a h G F with 

^/i = / 2 0((l-M)- 1 (t; 2 -t; 1 ))0(/ i ). 

Proof 
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Suppose gi and g 2 are 0-conjugate. Then there is a g% — (w, h) e G with 
9s9i = 92<f>(g3)- Therefore 

(w + v u hfi) = (v 2 + M-w, f 2 i/j(w)<f)(h)). 

Comparing the first components we obtain (1 — M) ■ w = v 2 — v 1 from 
which it follows that Vi is congruent to v 2 modulo (1 — M)W . Substituting 
(1 — M)~ l (v 2 — Vi) for w in the second component we obtain the second 
relation in the lemma. The argument can easily be reversed to give the 
converse. 

Proposition 3 In the notation described above 

R((f) = R(<pf imte ) x 

Proof We partition the set 1Z(4>) of 0-conjugacy classes of elements of G 
into smaller sets: 

11(4) = U ve %r /{1 _ M) %rTl(v) 

where TZ(v) is the set of 0-conjugacy classes {(w, /)}</, for which w is congru- 
ent to v modulo (1 — M)Zj r . It follows from the previous lemma that this is 
a partition. Now suppose {(w, /)}</> € 1Z(v). We will show that {(w, /)}</, = 
{(vj*)}^ for some/* E F. This follows by setting /* = f^((l-M)- 1 (w-v)) 
and applying the previous lemma with h = id. Therefore TZ(v) is the set of <fi- 
conjugacy classes {(v, /)}</, with / € F . From the previous lemma it follows 
that (v, fi) and (v, f 2 ) are 0-conjugate iff there is a h e F with 

fc/i = M(O)0(/i) = M/i) 

This just means that f\ and / 2 are 0^ mte -conjugate as elements of F. From 
this it follows that TZ(v) has cardinality R((j)f %nite ) . Since this is independent 
of v, we have 

R((f)) = Y,R{<l) finite ) =| det(l - M) I xR{<f) finite ). 

V 

Now consider the map 0°° : G/F — > G/F. We have 

F)) = (M • u, = (M • u, F). 
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From this it follows that 0°° is isomorphic to map M : ZZ r — > Zj r . This 
implies 

#(0°°) = R(M : W -> 

but it is known |flj that i?(M : ^ r -> =| det(l — M) \. Therefore 
R((f>) = R((fif mite ) x i2(0°°) , proving proposition 3 . 

Let W be the complex vector space of complex valued class functions on 
the group F.The map induces a linear map B : W —+ W defined as above 
in theorem 15. 

Theorem 18 If G is the direct sum of a free Abelian and a finite group and 
an endomorphism of G . Then we have 

R((j)) = (-l) r +p£(-l)*Tr (A>°° ® B). (2.22) 

where k is rg(G/ F) , p the number of fi G Spec 0°° such that \x < — 1, and r 
the number of real eigenvalues of cj) 00 whose absolute value is > 1. 

Proof Theorem follows from lemmas 15 and theorem 15 , proposition 3 
and formula 

Tr (A>°°) • Tr (B) = Tr (A>°° ® B). 

Theorem 19 Let G is the direct sum of free Abelian and a finite group and 
(p an endomorphism of G . If the numbers R((p n ) are all finite then Rj>(z) is 
a rational function and is equal to 

( k \ ( ~ ir 

R^z) = |JJ det(l - A>°° ® B ■ a ■ z) { - iy+1 j (2.23) 

where matrix B is defined in theorem 15, a = (—l) p ,p , r and k are constants 
described in lemma 17 . 

Proof From proposition 3 it follows that i?(0 n ) = J R((0 oo ) n - J R((0 /inite ) n ). 
From now on the proof repeat the proof of the theorem 12. 

Corollary 6 Let the assumptions of theorem 19 hold. Then the poles and 
zeros of the Reidemeister zeta function are complex numbers which are the 
reciprocal of an eigenvalues of one of the matrices 

A'(0°°) ®B-a < i < rank G 
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Another proof of rationality of the Reidemeister zeta function gives 

Theorem 20 If G is the direct sum of a finitely generated free Abelian and 
a finite group and <p an endomorphism of G then R,p(z) is a rational function 
and is equal to the following additive convolution: 

R (P (z) = R™(z)*Rl mUe (z). (2.24) 

where R^(z) is the Reidemeister zeta function of the endomorphism 0°° : 
G°° — > G°° , and R^ mte {z) is the Reidemeister zeta function of the endomor- 
phism <pf inite : G finite -> G finite . The functions R$>(z) and R^ nii \z) are 
given by the formulae 

(— i) r 

B%(z)= mdet(l-A>~.^)(-')' + 'j , (2.25) 

l<9>] 

The product here is over all periodic (p-orbits of ordinary conjugacy classes 
of elements of G. The number #[< g >] is the number of conjugacy classes 
in the (fi- orbit of the conjugacy class < g >. Also, a = (— l) p where p is 
the number of real eingevalues A G Spec 0°° such that A < — 1 and r is the 
number of real eingevalues A G Spec 0°° such that | A | > 1 . 

Proof From proposition 3 it follows that R((f) n ) = J R((0 oo )"- J R((0^ nite ) n ). 
From this we have 

R</,(z) = R^)(z) * R f ™ lte {z). 

The rationality of R<j,(z) and the formulae for R°f(z) and R^ nite (z) follow 
from the lemma 13 , lemma 17 and theorem 16 . 

Theorem 21 (Functional equation) Let : G — > G be an endomorphism 
of a group G which is the direct sum of a finitely generated free Abelian and 
a finite group. If G is finite the functional equation of R^ is described in 
theorem 16. If G is infinite then R^ has the following functional equation: 

R* (£) = e 2 ■ R,(z)^ k ° . (2.26) 
where d = det (0°° : G°° — > G°°) and e 2 are a constants in (D* . 
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Proof From proposition 3 we have R$(z) = R™(z) * R™ % e (z). In the 
lemma 19 and theorem 16 we have obtained functional equations for the func- 
tions R™{z) and R^ nite (z). Now, lemma 14 gives us the functional equation 
for R$(z). 



2.6 Endomorphisms of nilpotent groups 

In this section we consider finitely generated torsion free nilpotent group 
T.It is well known that such group T is a uniform discrete subgroup of a 
simply connected nilpotent Lie group G (uniform means that the coset space 
G/Y is compact). The coset space M = G/Y is called a nilmanifold. Since Y = 
7i"i(M) and M is a K(Y, 1), every endomorphism : Y — > Y can be realized 
by a selfmap / : M — > M such that /* = </> and thus R(f) = R(4>)- Any 
endomorphism <fi : Y — > Y can be uniquely extended to an endomorphism 
F : G — > CLet F : G — ► G be the corresponding Lie algebra endomorphism 
induced from F. 

Theorem 22 If Y is a finitely generated torsion free nilpotent group and 4> 
an endomorphism of Y . Then 

m 

R((f>) = (-l) r+ f^(-l) J Tr AT, (2.27) 

i=0 

where m is rgY = dimM, p the number of \x G Spec F such that [l < — 1, 
and r the number of real eigenvalues of F whose absolute value is > 1. 

PROOF: Let / : M — > M be a map realizing on a compact nilmanifold 
M of dimension m.We suppose that the Reidemeister number R(f) = R{4>) is 
finite. The finiteness of R(f) implies the nonvanishing of the Lefschetz number 
L(f) [0].A strengthened version of Anosov's theorem 0] is proven in [ffT| 
which states, in particular, that if L(f) ^ than N(f) = \L(f)\ = R(f).lt 
is well known that L(f) = det(F — 1) Q.Prom this we have 

R{4>) = R(f) = \L(f)\ = | det(l - F)\ = (-l)^det(l — F) = 

m 
i=0 
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Theorem 23 If T is a finitely generated torsion free nilpotent group and <f> 
an endomorphism ofT .Then R^z) is a rational function and is equal to 

(m \(~l) r 

R^z) = (JIdet(l — A l F ■ a ■ z)^ l+l J (2.28) 

where a = (—l) p ,p , r , m and F is defined in theorem 22. 

Proof If we repeat the proof of the previous theorem for n instead 
we obtain that R(<f) n ) = (— l) r+pn det(l — F)( we suppose that Reidemeister 
numbers R(<f) n ) are finite for all n).Last formula implies the trace formula for 
R((j) n ) : 

m 

R((j) n ) = (-l) r +P n ^(-l) i Tr (A i F) n 

i=0 

Now theorem follows immediately by direct calculation as in lemma 17. 

Corollary 7 Let the assumptions of theorem 23 hold. Then the poles and 
zeros of the Reidemeister zeta function are complex numbers which are re- 
ciprocal of an eigenvalue of one of the matrices 

A i (F) : A i (G) — ► A^G) 0<i< rank G 
2.6.1 Functional equation 

Theorem 24 Let <p : F — > T be an endomorphism of a finitely generated 
torsion free nilpotent group T. Then the Reidemeister zeta function R<j,{z) has 
the following functional equation: 

i?,(^)=e 1 -^(,)(- 1 ) RankG . (2.29) 

where d = det F and e\ are a constants in (D* . 

Proof Via the natural nonsingular pairing (A l F) <g> (A m ~ l F) — > (T the 
operators A m ~ % F and d.(A l F)~ l are adjoint to each other. 
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We consider an eigenvalue A of A l F. By theorem 23, This contributes a 
term 



'0 ( - 1,<+, P 



We rewrite this term as 



dcr^A ±; ( —dz 



X J \ \a J 

and note that | is an eigenvalue of A m ~ l F. Multiplying these terms together 
we obtain, 

Mi) = fn n ( s b) < " 1, T " xw-«™. 

The variable z has disappeared because 

TO TO 

X;(-l) i dimA i G = X;(-l) i C fc i = 0. 

i=0 i=0 

2.7 The Reidemeister zeta function and gro- 
up extensions. 

Suppose we are given a commutative diagram 

G ^ G 

I P I P (2.30) 

G G 

of groups and homomorphisms. In addition let the sequence 

0^ H ^G ^G ^0 (2.31) 
be exact. Then restricts to an endomorphism <p \ H : H — > H. 
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Definition 11 The short exact sequence (2.31) of groups is said to have a 
normal splitting if there is a section o : G — > G of p such that Im a = o~(G) 
is a normal subgroup of G. An endomorphism <fi : G — > G is said to preserve 
this normal splitting if <p induces a morphism of (2.31) with (p{a{G)) C o(G). 

In this section we study the relation between the Reidemeister zeta func- 
tions R<p(z), R^(z) and R (f) \ H (z). 

Theorem 25 Let the sequence (2.31) have a normal splitting which is pre- 
served by (ft : G — > G. Then we have 

R 4>i z ) = R $( z ) * R 4>\h( z )- 

In particular, if Rz(z) and R^\ H (z) are rational functions then so is R^{z). 
If Rf(z) and R^ H (z) are rational functions with functional equations as de- 
scribed in theorems 21 and 24 then so is R<f,(z). 

PROOF From the assumptions of the theorem it follows that for every 
n > 

R{<j) n ) = R(f) ■ R(<p n \ H ) (seegg). 

2.8 The Reidemeister zeta function of a con- 
tinuous map 

Using Corrolary 1 from Chapter 1 we may apply all theorems about the 
Reidemeister zeta function of group endomorphisms to the Reidemeister zeta 
functions of continuous maps. Theorem 16 yield 

Theorem 26 Let X be a polyhedron with finite fundamental group 7fi(X) 
and let f : X — > X be a continuous map. Then Rf{z) is a rational function 
with a functional equation: 

Rf (z) = R~ f Sz) = n 1 _^ l<g>r 
[<<?>] 1 z 

Rf (;) = (-l) a z b R f (z). 
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The product in the first formula is over all periodic J ^-orbits of ordinary 
conjugacy classes of elements ofiii(X). The number #[< g >] is the number 
of conjugacy classes in the f^-orbit of < g >. In the functional equation the 
numbers a and b are respectively the number of periodic /*- orbits of cojugacy 
classes of elements of tti(X), and the number of periodic conjugacy classes 
of elements of ti\{X). 

Theorem 10 yield 

Theorem 27 Let f : X — > X be eventually commutative. Then Rf(z) is a 
rational function and is given by: 

R f (z) = R f Sz) = R fl M = Rfjz) * R% ite (z), 

where R^ (z) is the Reidemeister zeta function of the endomorphism : 
H ± (X, %)°° -> Hi(X, andR f f ™ ite (z) is the Reidemeister zeta function of 
the endomorphism fH nite : H^X, %)f inite -> H^X, %y inite . The functions 
Kj? t (z) and R^ lte {z) are given by the formulae: 

( k / • w-u i+1 \ ( ~ ir 
i^.W = ^IIdet(l-A7 1 ^) 1 J 

[h] 1 z 

With the product over [h] being taken over all periodic fu- orbits of torsion 
elements h G H±(X, Z), and with a = (— l) p where p is the number of n e 
Spec fi% such that /i < — 1. The number r is the number of real eigenvalues 
°f fu whose absolute value is > 1 . 

Theorem 13 yield 

Theorem 28 (Connection with Lefschetz zeta function) Let f : X — > 

X be eventually commutative. Then 




where r and a are constants as described in theorem 27 . If X is a polyhedron 
with finite fundamental group then this reduces to 

R f (z) = R h (z) = %.(*) = L^z), 
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Theorem 29 (Functional equation) Let f : X — > X be eventually com- 
mutative. If Hi(X;%) is finite, then R/(z) has the following functional 
equation: 

Rf Q = (-l) p z«R f (z), 

where p is the number of periodic orbits of fu in Hi(X;Z) and q is the 
number of periodic elements of fu in H\(X; Z). 

If Hi(X; Z) is infinite then Rf(z) has the following functional equation: 

R f {£) = e 2 .R f (z)(-^ nk 

where d = det(f^) G W* and e 2 G W* is a constant. 
Theorem 20 yield 

Theorem 30 Let X be a polyhedron whose fundamental group n is the direct 
sum of a finitely generated free Abelian and a finite group. Let f : X — > X 
be a continuous map. Then Rf(z) is a rational function and is equal to the 
following additive convolution: 

R f (z)=Rl(z)*Rf; ite (z). (2.32) 

where RJ*(z) is the Reidemeister zeta function of the endomorphism f%° : 
7r°° — > 7r°° , and R~ mte (z) is the Reidemeister zeta function of the endomor- 
phism fl %mte : 7r^ mite — > nf' imte . The functions RJ- '(z) and R^- mite {z) are given 
by the formulae 



R JS Z ) = [U det (! " • , (2.33) 

R f inite, s TT 1 

"f. {> 11, 1- Z #[<9>]> 

[<9>] 

The product here is over all periodic f ^-orbits of ordinary conjugacy classes 
of elements of n. The number #[< g >] is the number of conjugacy classes 
in the f*- orbit of the conjugacy class < g >. Also, a = (— l) p where p is 
the number of real eingevalues A G Spec f%° such that A < — 1 and r is the 
number of real eingevalues A G Spec f£° such that | A | > 1 . 
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Theorem 31 Let f : X — > X be a self map of of a nilmanifold. Then 

( m / ~ n f-iv+i\ 

Rf{z) = \J[deb(l-A t F-<T-z) j 

where a = (—l) p ,p , r, m and F is defined in theorem 22, d = det F and e x 
are a constants in (D* . 



2.8.1 The Reidemeister zeta function of a continuous 
map and Serre bundles. 

Let p : E — > B be a Serre bundle in which E, B and every fibre are connected, 
compact polyhedra and Ff, = p~ l (b) is a fibre over b G B. A Serre bundle 
p : E —>■ B is said to be (homotopically) orientable if for any two paths 
w, w' in _B with the same endpoints w(0) = w'(0) and w(l) = w'(l), the 
fibre translations r w , r w < : ^(o) — > F w (l) are homotopic. A map f : E E is 
called a fibre map if there is an induced map / : B — » i? such that pof — fop. 
Let p : -E — > i? be an orientable Serre bundle and let / : E — * i£ be a fibre 
map. Then for any two fixed points b, V of / : B — > B the maps fb = f\p b 
and fv = f {fu have the same homotopy type; hence they have the same 
Reidemeister numbers R(fb) = R(fb') HQ] ■ 



The following theorem describes the relation between the Reidemeister 
zeta functions Rf(z), Rj{z) and Rf b {z) for a fibre map / : E — ► E of an 
orientable Serre bundle p : E B. 

Theorem 32 Suppose that f : E — > E admits a Fadell splitting in the sense 
that for some e in Fix / and b = p(e) the following conditions are satisfied: 

1. the sequence 

— > tti(F 6 , e) 7n(S, e) ^ 7n(fl, e) — > 

zs exact, 



2. p* admits a right inverse (section) a such that Im a is a normal sub- 
group ofirx(E,e) and /*(Im a) C Im a. 
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We then have 

R f (z)=R f (z)*R fb (z). 

If Rf(z) and Rf b (z) are rational functions then so is Rf(z). If Rj(z) and 
Rf b (z) are rational functions with functional equations as described in theo- 
rems 26 and 29 then so is R/(z). 

Proof The proof follows from theorem 25 . 



Chapter 3 



The Nielsen zeta function 



3.1 Radius of Convergence of the Nielsen 
zeta function 

In this section we find a sharp estimate for the radius of convergence of the 
Nielsen zeta function in terms of the topological entropy of the map. It 
follows from this estimate that the Nielsen zeta function has positive radius 
of convergence. 

3.1.1 Topological entropy 

The most widely used measure for the complexity of a dynamical system 
is the topological entropy. For the convenience of the reader, we include its 
definition. Let / : X — > X be a self-map of a compact metric space. For given 
e > and n e IN, a subset E C X is said to be (n, e)-separated under / if 
for each pair x 7^ y in E there is < % < n such that d(f l (x), f l {y)) > e. Let 
s n (e, f) denote the largest cardinality of any (n, e)-separated subset E under 
/. Thus s n (e, f) is the greatest number of orbit segments x, f(x), f n ^ 1 (x) 
of length n that can be distinguished one from another provided we can only 
distinguish between points of X that are at least e apart. Now let 

h(f, e) := lim sup - • log s„(e, /) 
n n 

h(f) := limsup/i(/,e). 
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The number < h(f) < oo, which to be independent of the metric d used, 
is called the topological entropy of /. If h(f, e) > then, up to resolution 
e > 0, the number s n (e, f) of distinguishable orbit segments of length n grows 
exponentially with n. So h(f) measures the growth rate in n of the number of 
orbit segments of length n with arbitrarily fine resolution. A basic relation 
between Nielsen numbers and topological entropy was found by N.Ivanov 
[[55H and independently by Aronson and Grines. We present here a very short 
proof of Jiang [E2j of the Ivanov's inequality. 



Lemma 22 ]5q/ 



h(f) > limsup- ■ log iV(D 
n n 

Proof Let 8 be such that every loop in X of diameter < 28 is contractible. 
Let e > be a smaller number such that d(f(x), f(y)) < 8 whenever d(x, y) < 
2e. Let E n C X be a set consisting of one point from each essential fixed 
point class of /". Thus | E n \— N(f n ). By the definition of h(f), it suffices 
to show that E n is (n, e)-separated. Suppose it is not so. Then there would 
be two points x ^ y e E n such that d(f l (x), f l (y)) < e for o < i < n 
hence for all i > 0. Pick a path q from f l (x) to f l (y) of diameter < 2e for 
o < i < n and let c n = c . By the choice of 8 and e , / o q ~ c i+ i for all 
i, so f n o Co — c n = Co- This means x, y in the same fixed point class of f n , 
contradicting the construction of E n . 

This inequality is remarkable in that it does not require smoothness of 
the map and provides a common lower bound for the topological entropy of 
all maps in a homotopy class. 

We denote by R the radius of convergence of the Nielsen zeta function 
Nf(z). Let h = inf h(g) over all maps g of the same homotopy type as /. 

Theorem 33 For a continuous map of a compact polyhedron X into itself, 

R > exp(-h) > 0. (3.1) 

Proof The inequality R > exp(-h) follows from the previous lemma, the 
Cauchy-Hadamard formula, and the homotopy invariance of the radius R of 
the Nielsen zeta function Nf(z). We consider a smooth compact manifold 
M which is a regular neighborhood of X and a smooth map g : M — > M of 
the same homotopy type as /. As is known |75| , the entropy h(g) is finite. 
Thus exp(— h) > exp(—h(g)) > 0. 
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3.1.2 Algebraic lower estimation for the Radius of Con- 
vergence 

In this subsection we propose another prove of positivity of the radius R and 
give an exact algebraic lower estimation for the radius R using the Reide- 
meister trace formula for generalized Lefschetz numbers. 

The fundamental group n = tti(X,Xo) splits into /*-conjugacy classes. Let 
7Tf denote the set of /*-conjugacy classes, and Ziif denote the abelian group 
freely generated by 717 . We will use the bracket notation a — > [a] for both 
projections 7r — > 7T/ and /Ztt — > Ztt/. Let x be a fixed point of /.Take a path 
c from xo to x.The /*-conjugacy class in n of the loop c ■ (/ o c) _1 , which is 
evidently independent of the choice of c, is called the coordinate of x.Two 
fixed points are in the same fixed point class F iff they have the same coordi- 
nates. This /*-conjugacy class is thus called the coordinate of the fixed point 
class F and denoted cd n (F, f) (compare with description in section 1). 



The generalized Lefschetz number or the Reidemeister trace J78[ is defined 

as 

L n (f) := £ Index (FJ).cd w (FJ) E Z* f , (3.2) 

F 

the summation being over all essential fixed point classes F of /.The 
Nielsen number N(f) is the number of non-zero terms in L 7r (/),and the in- 
dices of the essential fixed point classes appear as the coefficients in L 7r (/).This 
invariant used to be called the Reidemeister trace because it can be computed 



as an alternating sum of traces on the chain level as follows |[78||,||971| . Assume 



that X is a finite cell complex and / : X — > X is a cellular map. A cellular 
decomposition of X lifts to a 7r-invariant cellular structure on the universal 
covering A. Choose an arbitrary lift for each . They constitute a free 
^/T-basis for the cellular chain complex of A. The lift / of / is also a cellular 
map. In every dimension d, the cellular chain map / gives rise to a ^7r-matrix 
Fd with respect to the above basis, i.e Fd = (a^-) if fief) = J2j a^-ej, where 
ajj G Z ir. Then we have the Reidemeister trace formula 

LM) = E(" 1 )1 Tr Fd] e 2Zn f . (3.3) 

d 

Now we describe alternative approach to the Reidemeister trace formula 
proposed recently by Jiang [f)2]| . This approach is useful when we study the 
periodic points of /, i.e. the fixed points of the iterates of /. 
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The mapping torus Tf of / : X — > X is the space obtained from X x [o, oo) 
by identifying (x, s + 1) with {f(x), s) for all x G X, s G [0, oo).On Tf there is 
a natural semi-flow : Tf x [0, oo) — > Tj, 0i(x, s) = (x, s+t) for all t > O.Then 
the map / : X — > X is the return map of the semi-flow 0. A point x G X 
and a positive number r > determine the orbit curve <f>r XT ) : = 4>t( x )o<t< T 

illT/ ' 

Take the base point xq of X as the base point of Tf. It is known that 
the fundamental group H := 7Ti(Ty,Xo) is obtained from 7r by adding a 
new generator z and adding the relations z~ x gz = f*{g) for all g G 7r = 
^(X, x ).Let H c denote the set of conjugacy classes in H. Let Z5H be the 
integral group ring of H, and let ZH C be the free abelian group with basis 
H c .We again use the bracket notation a — > [a] for both projections H — ► H c 
and — > /ZH C . If F n is a fixed point class of f n , then f(F n ) is also 
fixed point class of f n and Index (f(F n ), f n ) = Index (F n , f n ). Thus / acts 
as an index-preserving permutation among fixed point classes of f n . By 
definition, an n-orbit class O n of / to be the union of elements of an orbit of 
this action. In other words, two points x, x' G Fix (f n ) are said to be in the 
same n-orbit class of / if and only if some f l (x) and some f^(x') are in the 
same fixed point class of /".The set Fix (f n ) splits into a disjoint union of 
n-orbits classes. Point x is a fixed point of f n or a periodic point of period 
n if and only if orbit curve <p( x ,n) is a closed curve. The free homotopy class 
of the closed curve 4>{x,n) will be called the H -coordinate of point x, written 
cdn(x,n) = [(p( x , n )} G H c . It follows that periodic points x of period n and 
x' of period n' have the same incoordinate if and only if n = n' and x, x' 
belong to the same n-orbits class of /. Thus it is possible equivalently define 
x, x' G Fix /" to be in the same n-orbit class if and only if they have the 
same if— coordinate. 



Recently, Jiang |52| has considered generalized Lefschetz number with 
respect to H 

L H (f n ) := E Index (° n > D • cd H {O n ) G %H C , (3.4) 
and proved following trace formula: 

L H (f n ) = E(-!)1 Tr i zp d) n ] e %H C , (3.5) 
d 

where Fd be ^7r-matrices defined above and zFd is regarded as a iZTii-matrix. 
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For any set S let /ZS denote the free abelian group with the specified 
basis S.The norm in ZZS is defined by 

W^ksiW :=^2\ h\<E (3.6) 

i i 

when the Sj in S are all different. 

For a ZH-ma.thx A = (a^), define its norm by \\A\\ := ||oy||.Then 
we have inequalities \\AB\\ < \\A \ ■ \\B\\ when A,B can be multiplied, and 
||Tr A\\ < || A || when A is a square matrix. For a matrix A = (a^) in ^S", 
its matrix of norms is defined to be the matrix A norm := {\\dij\\) which is a 
matrix of non- negative integers. In what follows, the set S will be n, H or 
H c .We denote by s(A) the spectral radius of A, s(A) = lim n (||74 n || |) » , which 
coincide with the largest module of an eigenvalue of A. 

Theorem 34 For any continuous map f of any compact polyhedron X into 
itself the Nielsen zeta function has positive radius of convergence R, which 
admits following estimations 

R > > (3.7) 

max d \\zF d \\ 

and 

R> L >0, (3.8) 

m&x d s(F2 orm ) 

Proof By the homotopy type invariance of the invariants we can suppose 
that / is a cell map of a finite cell complex. By the definition, the Nielsen num- 
ber N(f n ) is the number of non-zero terms in L 7r (/ n ).The norm ||L#(/ n )|| 
is the sum of absolute values of the indices of all the n-orbits classes O n . 
It equals ||L 7r (/ n )||, the sum of absolute values of the indices of all the fixed 
point classes of f n , because any two fixed point classes of f n contained in 
the same n-orbit class O n must have the same index. From this we have 

N(n < wunw = HMD ii = ii^(-i) rf [Tr (^mi < 



< J2 m (zF d )»]\\ < E HTr (zF d r\\ < £ ||(^) n || < E ll(^) 

d d d d 
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sec 



52|).The radius of convergence R is given by Caushy-Adamar formula: 
4 = limsup(^-^ = limsup(iV(r))i 

R n Tl n 

Therefore we have: 

1 1 

R = r > =— > 0. 

limsup n (iV(/ n ))n max d \\zF d \\ 

Inequalities: 

AT(/-) < H^C/^IHil^C/^IHH^C-^^Tr (^^H^^llt^ (^) n ]ll< 

d d 

< J2 ||Tr {zF d ) n \\ < ]TTr {{zF d ) n ) norm < ^Tr {{zF d ) norm ) n < 

d d d 

< 5]Tr ((F d ) norm ) n 
d 

and the definition of spectral radius give estimation: 

1 1 

R = r > * > 0. 

limsup n (iV(/ n ))» max d s(F2 orm ) 

Example 7 Let X be surface with boundary, and f : X — > X be a map.Fadell 
and Husseini %2(\] devised a method of computing the matrices of the lifted 
chain map for surface maps. Suppose {a 1; a r } is a free basis for tti(X). 
Then X has the homotopy type of a bouquet B of r circles which can be 
decomposed into one 0-cell and r 1-cells corresponding to the ai,and f has 
the homotopy type of a cellular map g : B — > B. By the homotopy type 
invariance of the invariants,we can replace f with g in computations. The ho- 
momorphism f* : 7ii(X) — > iri(X) induced by f and g is determined by the 
images bi = i — 1, .., r. The fundamental group 7Ti(Tf) has a presenta- 

tion 7Ti(Ty) =< ai, a r , z\aiZ = zbi, % = 1, .., r > .Let 

be the Jacobian in Fox calculus(see Then, as pointed out in ][2(\] , the 

matrices of the lifted chain map g are 

P ° = ^ = D = ^- 

Now, we can find estimations for the radius R from (3.7) and (3.8). 
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3.2 Nielsen zeta function of a periodic map 

The following problem is of interest: for which spaces and classes of maps 
is the Nielsen zeta function rational? When is it algebraic? Can Nf(z) be 
transcendental? Sometimes one can answer these questions without directly 
calculating the Nielsen numbers N(f n ), but using the connection between 
Nielsen numbers of iterates. We denote N(f n ) by iV n .We shall say that / : 
X — > X is a periodic map of period m, if f m is the identity map id x ■ X — > X. 
Let fi(d),d G N, be the Mobius function of number theory. As is known, it 
is given by the following equations: n(d) — if d is divisible by a square 
different from one ; /i(d) = (— \) k if d is not divisible by a square different 
from one , where k denotes the number of prime divisors of d; = 1. 

Theorem 35 Let f be a periodic map of least period m of the connected 
compact polyhedron X . Then the Nielsen zeta function is equal to 

N f (z) = n <K i - ^)- pw 

d\m 

, where the product is taken over all divisors d of the period m, and P(d) is 
the integer 

P(d) = Y,Kdi)N dldl . 

di\d 

Proof Since f m = id, for each j,Nj = N m+ j. Since (k,m) = 1, there exist 
positive integers t and q such that kt = mq + 1. So {f k ) 1 = f kt = f m i +1 = 
fmqj = = /. Consequently, N((f k Y) = N(f). Let two fixed point 

x and x 1 belong to the same fixed point class. Then there exists a path 
a from x to Xi such that a * (/ o a) -1 ~ 0. We have f(a * / o a)^ 1 ) = 
(/ o a) * (f 2 o a)^ 1 ~ and a product a * (/ o a) -1 * (/ o a) * (/ 2 o a) -1 = 
a * (/ 2 o a)' 1 ~ 0. It follows that a * o a) -1 ~ is derived by the 
iteration of this process. So xq and x\ belong to the same fixed point class 
of f k . If two point belong to the different fixed point classes /, then they 
belong to the different fixed point classes of f k . So, each essential class( class 
with nonzero index) for / is an essential class for f k ; in addition , different 
essential classes for / are different essential classes for f k . So N(f k ) > N(f). 
Analogously, N(f) = N((f k Y) > N(f k ). Consequently , N(f) = N(f k ). 
One can prove completely analogously that N d = N di , if (i, m/d) =1, where 
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d is a divisor of m. Using these series of equal Nielsen numbers, one can 
regroup the terms of the series in the exponential of the Nielsen zeta function 
so as to get logarithmic functions by adding and subtracting missing terms 
with necessary coefficient. We show how to do this first for period m = p l , 
where p is a prime number . We have the following series of equal Nielsen 
numbers: 

Ni = N k , (k,p l ) = l(i.e.,noN ip ,N ip 2, ,N ipi ,i= 1,2,3, ....), 

N p = N 2p = N 3p = = N {p _ 1)p = N (p+1)p = ...(noN ip 2, N ip3 , ...,N ip i) 

etc.; finally, 

N p i-i = N 2p i-i = {noN ip i) 

and separately the number N p i. 
Further, 

i=i 1 i=i 1 i=i P 1 

(N p 2-(N p -N 1 )-N 1 ) Z p 



2 I 



+ E 2 — + ■■■ 

l= i p % 

( A/p; _..._(iV p _iV 1 )_iV 1 ) z P ii 



oo 



+ E 



i=i ^ * 

= -Aq • log(l - z) + • log(l - z?) + 

P 

+ Np ~ Np2 •log(l-^) + - 

+ ; ^-logl-Z P . 

pi 

For an arbitrary period m , we get completely analogously, 



N f (z) = exp(£^/) 

/ ~P(d) ^\ 

= exp FS^T'^ 

\d|m «=1 / 
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( E ' log(1 - 



= J] ^(i - z d )-nd) 

d\m 

where the integers P(d) are calculated recursively by the formula 

P(d)=N d - Yl P ( d i)- 

Moreover, if the last formula is rewritten in the form 

di\d 

and one uses the Mobius Inversion law for real function in number theory, 
then 

P(d) = J2Kd 1 )-N d/dl , 

di\d 

where fi(di) is the Mobius function in number theory. The theorem is proved. 

Corollary 8 // in Theorem 35 the period m is a prime number, then 

1 

(i ~ z y 



For an involution of a connected compact polyhedron, we get 

Remark 3 Let f : M n — > M n , n > 3 be a homeomorphism of a compact 
hyperbolic manifold. Then by Mostow rigidity theorem f is homotopic to pe- 
riodic homeomorphism g . So theorem 35 applies and the Nielsen zeta function 
Nf(z) is equal to 



N f (z)=N g {z) = H${l -**)-*-(*> 

d\m 

, where the product is taken over all divisors d of the least period m of g, and 
P(d) is the integer P{d) = E dl \d ^d^N^ 1 ). 
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Remark 4 Let f : X — > X be a continuous map of a connected compact poly- 
hedron X , homotopic to idx ■ Since the Lefschetz numbers L(f n ) = L(idx) = 
x(X), where xPO ^ s the Euler characteristic of X, then for xPO 7^ one 
has N(f n ) = N{id x ) = lforalln>0, and N f (z) = -±- z ; ifx(X) = 0, then 
N(f n ) = N{id x ) = Ofor all n > , and N f (z) = 1 



3.3 Orientation-preserving homeomorphisms 
of a compact surface 

The proof of the following theorem is based on Thurston's theory of orienta- 
tion-preserving homeomorphisms of surfaces |)T . 



Theorem 36 The Nielsen zeta function of an orientation-preserving home- 
omorphism f of a compact surface M 2 is either a rational function or the 
radical of a rational function. 

Proof The case of an orientable surface with x(M 2 ) > 0(S 2 ,T 2 ) is con- 
sidered in subsection 3.8. In the case of an orientable surface with x(M 2 ) < 
, according to Thurston's classification theorem, the homeomorphism / is 
isotopic either to a periodic or a pseudo-Anosov, or a reducible homeomor- 
phism. In the first case the assertion of the theorem follows from theorem 
35. If / is an orientation-preserving pseudo-Anosov homeomorphism of a 
compact surface(i.e. there is a number A > 1 and a pair of transverse mea- 
sured foliations (F s ,fi s ) and (F u ,fi u ) such that /(F s ,/i s ) = (F s ,jfi s ) and 
f(F u ,fx u ) = (F u , A/i")), then for each n > 0,N(f n ) = F(f n ) ||, ||, Q. 
Consequently, in this case the Nielsen zeta function coincides with the Artin- 
Mazur zeta function: Nf(z) = Ff(z). Since in [22] Markov partitions are 



constructed for a pseudo-Anosov homeomorphism, Manning's proof |M] of 
the rationality of the Artin-Mazur zeta function for diffeomorphisms satisfy- 
ing Smale's axiom A carries over to the case of pseudo-Anosov homeomor- 
phisms. Thus , the Nielsen zeta function Nf(z) is also rational. Now if / is 
isotopic to a reduced homeomorphism 0, then there exists a reducing system 
S of disjoint circles Si, S 2 , S m on intM 2 such that 



1) each circle Si does not bound a disk in M 2 ; 
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2) Si is not isotopic to Sj, i ^ j; 

3) the system of circles S is invariant with respect to 0; 

4) the system S has an open 0- invariant tubular neighborhood rj(S) such 
that each <fi -component Tj of the set M 2 — r](S) is mapped into itself by some 
iterate nj , rij > of the map 0; here <ft nj on Tj is either a pseudo-Anosov or 
a periodic homeomorphism; 

5) each band rj(Si) is mapped into itself by some iterate m \ rrii > 0; here 
0m; on 77(5^ j s a generalized twist (possibly trivial). 

Since the band r)(Si) is homotopically equivalent to the circle S 1 , as 
will be shown in subsection 3.8 the Nielsen zeta function N^m^z) is ratio- 
nal. The zeta functions N^(z) and N^{z) are connected on the - com- 
ponent Tj by the formula N^z) = n J N ( pn( K z n i)\ analogously, on the band 

rj(Si), Nj,(z) = m ^J N^rn^z 171 !). The fixed points of n , belonging to different 
components Tj and bands rj(Si) are nonequivalent [p6[,so the Nielsen number 
N((p n ) is equal to the sum of the Nielsen numbers N((f) n /Tj) and N(<p n /r)(Si)) 
of (j) -components and bands . Consequently, by the properties of the expo- 
nential, the Nielsen zeta function N<f,(z) = Nf(z) is equal to the product of 
the Nielsen zeta functions of the 0- components Tj and the bands f](Si), i.e. 
is the radical of a rational function. 

Remark 5 For an orientation -preserving pseudo-Anosov homeomorphism 
of a compact surface the radius of the Nielsen zeta function Nf(z) is equal to 

« = exp( _ M/ )) = _^ 

, where X(A) is the largest eigenvalue of the transition matrix of the topolog- 
ical Markov chain corresponding to f . 

3.3.1 Geometry of the Mapping Torus and Radius of 
Convergence 

Let / : M 2 — > M 2 be an orientation-preserving homeomorphism of a compact 
orientable surface, R the radius of convergence of Nielsen zeta function and Tf 
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be the mapping torus of /, i.e. Tf is obtained from M 2 x [0, 1] by identifying 

(x,0) to (f (x),l) , x G M 2 . 

Lemma 23 Let the Euler characteristic x{M 2 ) < 0. Then R = 1 if and 
only if the Thurston normal form for f does not contain pseudo-Anosov 
components. 

Proof Let <j) be a Thurston canonical form of /. Suppose that <fi does not 
contain a pseudo-Anosov component. Then <p is periodic or reducible by S, 
where on each 0-component <ft is periodic. If cf) is periodic then by theorem 
35 R — 1. If <p is reducible then in theorem 36 we have proved that the 
Nielsen zeta function N^z) = Nf(z) is equal to the product of the Nielsen 
zeta functions of the 0- components Tj and the bands rj(Si), i.e. has radius 
of convergence R = 1. 

A three-dimensional manifold M is called a graph manifold if there is a 
system of mutually disjoint two-dimensional tori {Tj} in M such that the 
closure of each component of M cut along UTj is a (surface) xS 1 . 

Theorem 37 Let x(M 2 ) < 0. The mapping torus Tf is a graph-manifold if 
and only if R = 1 . // IntTf admits a hyperbolic structure of finite volume 
, then R < 1. If R < 1 then f has an infinite set of periodic points with 
pairwise different periods. 

Proof T. Kobayashi |58j has proved that mapping torus Tf is a graph- 
manifold if and only if the Thurston normal form for / does not contain 
pseudo-Anosov components. So, lemma 23 implies the first statement of the 
theorem. Thurston has proved ||93|| , pOf that IntTf admits a hyperbolic struc- 



ture of finite volume if and only if / is isotopic to pseudo-Anosov homeomorp- 
hism. But for pseudo-Anosov homeomorphism 1 > R = exp(—h(f)) = ^tk> 
where A (A) is the largest eigenvalue of the transition matrix of the topolog- 
ical Markov chain corresponding to /.This proves the second statement of 
the theorem. If R < 1 thenThurston normal form for / does contain pseudo- 
Anosov components. It is known |58| that pseudo-Anosov homeomorphism 



has infinitely many periodic points those periods are mutually distinct. 

A link L is a finite union of mutually disjoint circles in a three-dimensional 
manifold. The exterior of L is the closure of the complement of a regular 
neighborhood of L. A link L is a graph link if the exterior of L is a graph 
manifold. Let S a set consisting of a finite number of periodic orbits of /. 
The set S x [0, 1] projects to a link Lj )S in the mapping torus Tf. 
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Corollary 9 Let x{M 2 — S < 0. The link Lf^ is a graph link if and only if 
R=l. 

Proof Homeomorphism / is isotope re/S to a diffeomorphism g. Let F be 
a surface obtained from M 2 — X by adding a circle to each end . Since g is 
different iable at each point of E , g extends to g : F — > F [f47|. By theorem 



37 Tg is a graph manifold if and only if R = 1. Hence L/^ is a graph link if 
and only if R — 1. 

3.4 The Jiang subgroup and the Nielsen zeta 
function 



From the homotopy invariance theorem (see |HJ) it follows that if a homotopy 
{h t } : / ^ p : X -> X lifts to a homotopy {^} : f = g : X ^ X, then 
we have Index (/,p(Fix /)) = Index (^,p(Fix ^)). Suppose is a cyclic 
homotopy {ht} : / = /; then this lifts to a homotopy from a given lifting / 
to another lifting /' = a o f, and we have 

Index (/, p(Fix /)) = Index (/, p(Fix ao /)). 

In other words, a cyclic homotopy induces a permutation of lifting classes 
(and hence of fixed point classes); those in the same orbit of this permutation 
have the same index. This idea is applied to the computation of Nf(z). 

Definition 12 The trace subgroup of cyclic homotopies (the Jiang subgroup) 
1(f) C 7r is defined by 



1(f) = la G 7T 



there exists a cyclic homotopy 
{h t } : / = /which lifts to 
{ht}:f = aof 



(see 



Let Z(G) denote the centre of a group G, and let Z(H, G) denote the 
centralizer of the subgroup H C G. The Jiang subgroup has the following 
properties: 
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1. 

J(/)cZ(/,(7r),7r); 

2. 

I(idx) C Z(tt); 

3. 
4. 

^(/(/))c/(go/); 

5. 

J(id*) C /(/). 

The class of path-connected spaces X satisfying the condition I{id^) = -k = 
tii(X,x ) is closed under homotopy equivalence and the topological product 
operation, and contains the simply connected spaces, generalized lens spaces, 
if-spaces and homogeneous spaces of the form G/Gq where G is a topological 
group and G a subgroup which is a connected, compact Lie group (for the 
proofs see [pT[]). 

From theorem 27 it follows: 



Theorem 38 Suppose that N(f n ) = R(f n ) for all n > 0, and that f is 
eventually commutative. Then the Nielsen zeta function is rational, and is 
given by 



N f (z) = R f (z) = 




where a, r, and [h] are as in theorem 27. The function written here has a 
functional equation as described in theorem 29. 
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Theorem 39 Suppose that f*(n) C 1(f) and L(f n ) ^ for every n > 0. 
Then Nf(z) = Rf(z) is rational and is given by (3.9). It has a functional 
equation as described in theorem 29. If L(f n ) = only for finite number of 
n,then 

N f (z) = R f (z)-exp(P(z)) 
where Rf(z) is rational and is given by (3.9 ) and P(z) is a polynomial. 

Proof We have /™(7r) C I{f n ) for every n > (by property 4 and the 
condition /*(7r) C 1(f))- For any a G 7T, p(Fix aof) = p(Fix /"(a) o/ n ) by 
lemmas 2 and 5 and the fact that a and f™a are in the same /"-conjugacy 
class( see lemma 7). Since /™(vr) C I(f n ), there is a homotopy : f n = 
f n which lifts to {h t \ : / n = f?{a) o / n . Hence Index (/ n ,p(Fix / n )) = 
Index (/ n ,p(Fix a o f n )). Since a G 7r is arbitrary, any two fixed point 
classes of f n have the same index. It immediately follows that L(f n ) = 
implies iV(/ n ) = and L(f n ) ^ implies A^(/ n ) = i?(/ n ). By property 1, 
f n (ir) C I(f n ) C Z(/"(7r),7r), so /"(t 1 ") is abelian. Hence /* is eventually 
commutative. If L(f n ) ^ for every n > then the first part of the theorem 
now follows from theorems 27 and 29 . If L(f n ) = only for finite number 
of n,then the fraction Nf(z)/Rf(z) = exp(P(z)), where P(z) is a polynomial 
whose degree equal to maximal n, such that L(f n ) ^ 0. This gives the second 
part of the theorem. 

Corollary 10 Let the assumptions of theorem 39 hold. Then the poles and 
zeros of the Nielsen zeta function are complex numbers of the form ( a b where 
b is the reciprocal of an eigenvalue of one of the matrices 

A*(fu) ■ ^(Hi(X; Z)°°) — ► A^H^X; Z)°°) 0<i< rank G 

and ( a is a ip th r oot of unity where ip is the number of periodic torsion ele- 
ments in H\(X] Z). The multiplicities of the roots or poles ( a b and ( a b' are 
the same if b = b' and hcf(a,ip) = he f (a!, iff). 

Remark 6 The conclusion of theorem 39 remains valid under the weaker 
precondition "there is an integer m such that f™(ir) C I(f m )" instead of 
/*(7r) C 1(f), but the proof is more complicated. 

From theorem 8 and results of Jiang [|5T] it follows: 
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Theorem 40 (Trace formula for the Nielsen numbers) Suppose that there is 
an integer m such that /™(7r) C I(f m ) and L(f) 7^ 0. Then 

k 

N(f) = R(f) = (-l) r+ "]r(-l)*Tr (AYi*°° <8> A). (3.10) 

i=0 

where k is rgHi(X, ,A is linear map on the complex vector space of 
complex valued functions on the group TorsHi(X, 2Z), p the number of /i e 
Spec such that \i < —1, andr the number of real eigenvalues of f™ whose 
absolute value is > 1. 

Theorem 41 Suppose that there is an integer m such that /™(7r) C I{f m ).If 
L(f n ) 7^ for every n > o ,then 

t k \ Mr 

N f (z) = R f (z) = (J[det(l - A7£ ® A - a ■ z)^ ) (3.11) 

If L(f n ) = only for finite number of n, then 

N f (z) = R f (z) • exp P(z) 

( k \ 
= ^II det ( 1 ~ A */£ ® A ■ ° ■ z) hlY+ j ■ expP(z) (3.12) 

Where P(z) is a polynomial ,A, k,p, and r are as in theorem 40. 
Proof 

If L(f n ) 7^ for every n > o ,then formula (3.11) follows from theorem 
12. If L(f n ) = 0, then N(f n ) = . If L(f n ) ^ 0, then N(f n ) = R(f n )(see 
proof of theorem 39 ).So the fraction Nf(z)/Rf(z) = exp(P(z)), where P(z) 
is a polynomial whose degree equal to maximal n, such that L(f n ) ^ 0. 

Corollary 11 Let the assumptions of theorem 41 hold. Then the poles and 
zeros of the Nielsen zeta function are complex numbers which are the recip- 
rocal of an eigenvalue of one of the matrices 

Vif^^A-a) 
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Corollary 12 Let I{id£) = n . If L(f n ) ^ for all n > then formula 
(3.11) is valid. If L(f n ) = for finite number of n , then formula (3.12) is 
valid. 

Corollary 13 Suppose that X is aspherical, f is eventually commutative. If 
L(f n ) ^ for all n > then formula (3.11) is valid. If L(f n ) = for finite 
number of n , then formula (3.12) is valid 

3.5 Polyhedra with finite fundamental group. 

For a compact polyhedron X with finite fundamental group, 7Ti(X), the 
universal cover X is compact, so we may explore the relation between L(f n ) 
and Index (p(Fix f n ))- 

Definition 13 The number yu([/ n ]) = #Fix defined to be the order of 
the finite group Fix is called the multiplicity of the lifting class [f n ], or 
of the fixed point class p(Fix /"). 

Lemma 24 (|T[|]) 

L(f n ) = A* ([/"]) • Index (f ,p(Fix /")). 

Lemma 25 ( ||51|| ) If R(f n ) = ^Coker (1 — /£) (in particular if f is even- 
tually commutative), then 

MLT]) = #Coker (1-fl). 

Theorem 42 Let X be a connected, compact polyhedron with finite funda- 
mental group 7T. Suppose that the action of it on the rational homology of 
the universal cover X is trivial, i.e. for every covering translation a £ tt, 
a*=id: H*(X, Q) -> H*(X, Q). If L(f n ) ^ for all n > then N f (z) is a 
rational function given by 



(3.13) 
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where the product is taken over all periodic /*- orbits of ordinary conjugacy 
classes in the finite group tti(X). This function has a functional equation as 
described in theorem 26. If L(f n ) = only for finite number of n, then 

N f (z) = R f (z)-e X p(P(z)), 
where P(z) is a polynomial and Rf(z) is given by formula (3.13) 

Proof Under our assumption on X, any two liftings f n and aof n induce 
the same homology homomorphism H*(X, Q) — > H*(X, Q), and have thus the 
same value of L(f n ). From Lemma 24 it follows that any two fixed point 
classes /" are either both essential or both inessential. If L(f n ) ^ for 
every n > then for every n there is at least one essential fixed point class 
of f n . Therefore for every n all fixed point classes of f n are essential and 
Nf(z) = Rf(z). The formula ( 3.13) for Rf(z) follows from theorem 16 . If 
L(f n ) = 0, then N(f n ) = . If L(f n ) ^ 0, then N(f n ) = R(f n ). So the 
fraction Nf(z)/Rf(z) = exp(P(z)), where P(z) is a polynomial whose degree 
equal to maximal n, such that L(f n ) ^ 0. This gives the second statement 
of the theorem. 

Let W be the complex vector space of complex valued class functions on 
the fundamental group 7r.The map /* induces a linear map B : W — > W 
defined by 

B{f) :=/o/.. 

Theorem 43 (Trace formula for Nielsen numbers) Let X be a connected, 
compact polyhedron with finite fundamental group ir. Suppose that the action 
of TV on the rational homology of the universal cover X is trivial, i.e. for 
every covering translation a G it, a* = id : H*(X,Q) — > H^X^Q). Let 
L(f) ^ O.Then 

N(f) = R{f) = Tr B, (3.14) 

Proof Under our assumption on X all fixed point classes of / are es- 
sential and N(f) = R(f) ( see proof of the previous theorem for n=l).The 
formula for N(f) follows now from theorem 15. 

Theorem 44 Let X be a connected, compact polyhedron with finite funda- 
mental group n. Suppose that the action of n on the rational homology of 
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the universal cover X is trivial, i.e. for every covering translation a E it, 
a* = id: H*(X, Q) -> H*(X, Q). If L(f n ) ^ for every n> o ,then 

If L(f n ) = only for finite number of n, then 

N f (z) = R f (z) • exp (P(z)) = ^ { ™l y (3-16) 
Where P(z) is a polynomial, B is defined in theorem 15 



Proof 

If L(f n ) 7^ for every n > o ,then N(f n ) = R(f n ) (see proof of theorem 
42) and formula (3.16) follows from theorem 17 . If L(f n ) = 0, then N(f n ) = 
. If L(f n ) ^ 0, then N(f n ) = R(f n ). So the fraction N f (z)/R f (z) = 
exp(P(z)), where P(z) is a polynomial whose degree equal to maximal n, 
such that L(f n ) ^ 0. 

Lemma 26 Lei X be a polyhedron with finite fundamental group 7r and let 
p : X ^ X be its universal covering. Then the action of n on the rational 
homology of X is trivial iff H*(X; Q) = H*(X; Q). 



Corollary 14 Let X be a compact 1- connected polyhedron which is a rational 
homology n-sphere, where n is odd. Let n be a finite group acting freely on 
X and let X = X/ir. Then theorems \2 and 44 o,pplie. 

Proof The projection p : X — > X = X /it is a universal covering space of 
X. For every a G 7r, the degree of a : X — > X must be 1, because L(a) = 
(a has no fixed points). Hence a* = id: H*(X; Q) — > H*(X; Q). 

Corollary 15 If X is a closed 3-manifold with finite n, then theorems 42 
and 44 applie. 

PROOF X is an orientable, simply connected manifold, hence a homology 
3-sphere. We apply corollary 14 . 
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Corollary 16 Let X = L(m, q\, . . . , q r ) be a generalized lens space and f : 
X — > X a continuous map with /i*(l) = d where \ d |^ 1. The Nielsen and 
Reidemeister zeta functions are then rational and are given by the formula: 



N f (z) = R f (z) = n T^rXT = II (! - e^'™*)" ® 
[/i] 1 2 t=i 



where [h] runs over the periodic f u -orbits of elements of H^X; Z). The 
numbers a(t) are natural numbers given by the formula 

*(*) E "4^ 

¥>d(s) 

s I m such that 

<Pd(m) | tip d (s) 

where tp is the Euler totient function and (fd{s) is the order of the multiplica- 
tive subgroup of {2Z/ sZ) x generated by d. 

PROOF By corollary 14 we see that theorem 42 applies for lens spaces. 
Since iri(X) = 2Z/m2Z, the map / is eventually commutative. A lens space 
has a structure as a CW complex with one cell e$ in each dimension < % < 
2n + 1. The boundary map is given by de-ik = m-^k-i f° r even cells, and 
de2k+i = for odd cells. From this we may calculate the Lefschetz numbers: 

L(f n ) = 1 - d (l+1)n ^ 0. 

This is true for any n as long as | d |^ 1. Then by theorem 42 we have 
N{fn) = R{fl) = #Coker (1 _ fl) 

where /i* is multiplication by d. One then sees that (1 — fi # )(Z/mZ) — (1 — 
d n ){%/m%) and therefore Coker (1 - f[\) = (Z/mZ)/(l - d n ){{Z/m%). 
The cokernel is thus a cyclic group of order hcf(l — d n ,m). 

We briefly investigate the sequence n h- > hcf(l — d n ,m). It was originally 
this calculation which lead us to the results of section 2.4. 

Let : IN -> W be the Euler totient function, ie. y?(r) = #(^/r^) x . 
In addition we define y^fr) to be the order of the multiplicative subgroup of 
(/Z /r/Z)* generated by d. One then has by Lagrange's theorem tfd(r) I l f{ r )- 
The number ip(r) is the smallest n > such that <i n = 1 mod r. 
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The sequence n \— > hcf(l — d n , m) is periodic in n with least period ipd(m). 
It can therefore be expressed as a finite Fourier series: 



( 2-Kint \ 

hcf(l-d n ,m) = Y a(t)exp 
t=i 



^d{ m )J ' 

The coefficients a(t) are given by Fourier's inversion formula: 

1 ^ (m) ( -2mnt\ 

a(t) — — 7 — r ^ hcf(l — d n , m) exp ; — — 

Mm) ti \ Mm) J 

After a simple calculation, one obtains the formula: 



exp ( hCf(1 n dn,m) z n ) = ^ff \l " e^l^z)- 



3 2wit/ip d (m) z ^-a(t) 

Vra=l / t=l 

We now calculate the coefficients a(t) more explicitly. We have hcf(d n — 
1, m) = r iff d n = 1 mod r and for all primes p \ ™, d n ^ 1 mod pr. This 
is the case if and only if n = mod y^fV) and for all primes p | — , n ^ 
mod ifdipr). Using this we partition the sum in the expression for a(t): 

^ V ; r l™ n = l suc h that V y K 1 ' 

n = mod <£>d(r) and 
Vp \ f, n^O mod v? d (pr) 



We define 



^ /-27rmA 
V M m ) J 



n = 1 such that 
n = mod (pd(r) 

Using this we rewrite the inner sum in the expression for a(t). 

(-2mnt\ 

^ exp {~M^r 

n = 1 such that 
n = mod y?d(V) and 
Vp | ™, n ^ mod (fd(p r ) 

= 9(r) ~ Y 9(Pi r ) + Y 9(PiP2r) - 

Pl\f Pl,P2|f 
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Here the second sum is over all 2-element sets of primes {pi,P2} such that 
Pi and pi both divide ™. Substituting this into our expression for a(t) we 
obtain, 

a< ^> = T7^rE r \9( r ) ~ E 9(Pir) + E gipifrr) - . . .) ■ 
We now change the variable of summation: 

a(t) = —^y^g(s) Is- V-+ V — 
The large bracket here can be factorized into a kind of Euler product: 

This is then seen to be exactly the Euler totient function: 

On the other hand, a simple calculation shows 

g(s) = { "iM if Mm) I 
( otherwise. 

From this we have 

«(*) E ^TT- 

¥>d(s) 

s | m such that 

It is now clear that the coefficients a(t) are natural numbers, and we have 
the formula stated. 

Remark 7 Let X = L 2l+1 (m, qi,q2,---,Qr) an d let f : X — > X be an con- 
tinuous map. If f induces the trivial map on the cyclic group ni(X) then we 
have, 

N f (z) = 1, R f (z) ' 



1-z)' 
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If f induces the map g 



RAz) 



N f (z) 



-g on 7T\{X) then we have 

— if m is even, 



1 



(i-*)-a-(i+*)-r 



-y if m is odd, 



l-z 2 



if I is odd, 

if Z is even and m is even, 



/i±z ^ j even and m is odd. 

1— z 



We have now described explicitly all the Reidemeister and Nielsen zeta func- 
tions of all continuous maps of lens spaces. Apart from one exception they 
are all rational. 



3.6 Nielsen zeta function in other special cases 

Theorems 22 and 31 implie 

Theorem 45 Let f be any continuous map of a nilmanifold M to itself. If 
R(f n ) is finite for all n then 

N s {z)=R f {z) = (jldetil-VF.a.zf- 1 ^ ] (3.17) 

where a = (—l) p ,p , r , m and F is defined in theorem 31. 



Theorem 46 Suppose M is a orientable compact connected 3-manifold such 
that intM admits a complete hyperbolic structure with finite volume and 
f : M —>■ M is orientation preserving homeomorphism. Then Nielsen zeta 
function is rational and 

Nf(z) = L f (z) 



Proof B.Jiang and S. Wang |53| have proved that N(f) = L(f). This 
is also true for all iterations. 
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3.6.1 Pseudo-Anosov homeomorphism of a compact 
surface 

Let X be a compact surface of negative Euler characteristic and / : X — > X 
is a pseudo-Anosov homeomorphism,i.e. there is a number A > 1 and 
a pair of transverse measured foliations (F s ,fi s ) and (F u ,fi u ) such that 



f(F s ,{i s ) = (F s and f(F u ,n u ) = (F u , X/jl u ). Fathi and Shub |2 



has proved the existence of Markov partitions for a pseudo-Anosov home- 
omorphism. The existence of Markov partitions implies that there is a sym- 
bolic dynamics for (X, /).This means that there is a finite set N, a matrix 
A = (<iij)(ij)eNxN with entries or 1 and a surjective map p : Q — ► A, where 

such that p o cr = / o p where a is the shift (to the left) of the sequence (x n ) 
of symbols. We have first |TT| : 



#Fix a" = Tr A n . 

In general p is not bijective.The non-injectivity of p is due to the fact that the 
rectangles of the Markov partition can meet on their boundaries. To cancel 
the overcounting of periodic points on these boundaries,we use Manning's 
combinatorial arguments [pi] proposed in the case of Axiom A diffeomor- 
phism (see also [fH| ) . Namely, we construct finitely many subshifts of finite 
type crj, i = 0,1, ..,m, such that cr = a, the other shifts semi-conjugate with 
restrictions of / |72| ,and signs G { — 1, 1} such that for each n 



#Fix /» = J> * # Fix < = • Tr A? 



1 1 

i=0 



where is transition matrix, corresponding to subshift of finite type av For 
pseudo-Anosov homeomorphism of compact surface N(f n ) = #Fix (f n ) for 
each n > o f9l|.So we have following trace formula for Nielsen numbers 



Lemma 27 Let X be a compact surface of negative euler characteristic and 
f : X — > X is a pseudo-Anosov homeomorphism. Then 

m 

iV(D = ]>>-Tr Af. 

i=0 
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This lemma implies 

Theorem 47 Let X be a compact surface of negative Euler characteristic 
and f : X — > X is a pseudo-Anosov homeomorphism. Then 

m 

N f (z) = J] det (! - A i z Y u ( 3 - 18 ) 

i=0 

where A4 and q the same as in lemma 27. 

3.7 The Nielsen zeta function and Serre bun- 
dles. 

Let p : E — > B be a orientable Serre bundle in which E 1 , B and every fibre 
are connected, compact polyhedra and F b = is a fibre over b £ B ( see 

section ). Let / : E — > be a fibre map. Then for any two fixed points 6, 6' 
of / : 5 — > B the maps /& = / \p b and /&/ = / j^, have the same homotopy 
type; hence they have the same Nielsen numbers N(fb) = N(fy) . The 
following theorem describes the relation between the Nielsen zeta functions 
Nf(z), Nf(z) and Nf b (z) for a fibre map / : E — > E of an orientable Serre 
bundle p : E ^ B. 

Theorem 48 Suppose that for every n > 

JJ tfJV(tf) = N(f b ) , where b e Fix (f n ),K = K b = Ker{i* : 7n(F b ) -> 
Ti(^))/ 

^ m every essential fixed point class of f n , there is a point e such that 

p*(Fix (7n(S,e) ( Q* 7Ti (.£/, e) == Fix (7n(fl,6o) ^ 7n(S,6o), 

where b = p(e) . We then have 

N f (z)=N f (z)*N fb (z). 

If NjiyZ) and Nf b (z) are rational functions then so is Nf(z). If Nj{z) and 
Nf b (z) are rational functions with functional equations as described in theo- 
rem 38 and J±2 then so is Nf(z). 
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Proof From the conditions of the theorem it follows that 

N{fn) = N{f - n) . N{f n ) 

for every n( see [0Tj). From this we have 

N f (z)=N f (z)*N fb (z). 

The rationality of Nf(z) and functional equation for it follow from lemmas 
13 and 14 . 

Corollary 17 Suppose that for every n > homomorphism 1 — (/ n )* : 
7r 2 (-B,6) — > 7r 2 (-B,6) is an epimorphism. Then the condition 1) above is 
satisfied. 



Corollary 18 Suppose that f : i£ — > E admits a Fadell splitting in the sense 
that for some e in Fix / and b = p(e) the following conditions are satisfied: 

1. the sequence 

— > Tr x {F h , e) 7n(E, e) ^ 7n(5, e) — > 

zs exact, 

2. p* admits a right inverse (section) o such that Im a is a normal sub- 
group of7Ti(E,e) and /*(Im a) C Im a. 

Then theorem 4-8 applies. 



3.8 Examples 

Let / : X — > X be a continuous map of a simply connected, connected, 
compact polyhedron. Then Rf(z) = j^. 

Let X = S 1 and / : S 1 — ► S 1 be continuous map of degree d.Then 
N(f n ) =\ 1 — d n \, and the Nielsen zeta function is rational and is equal to 



1-2 

l-dz 



if d > 



iV / (z)= ^ if d = 



1+2 

1+dz 



if d < 
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If X = S 2n , and / : S 2n — > S 2n is a continuous map of degree d then 

if d = -1 



N f (z) 



VT- 



^- if d ^ — 1. 

1 — 2 ' 



Now if X = S' 2n+1 , and / : S 2n+1 — > S 2n+1 is a continuous map of degree d 
then 

' 1 if d = 1 



JV>(s) 



if d = -1 

1 — z 

if Id M 1. 

1—2 I I ' 



Thus, even on a simply connected space the Nielsen zeta function can be 
the radical of a rational function. In the next example X = T n is torus 
and / : T n — > T n is a hyperbolic endomorphism of the torus . Hyperbolic 
means that the covering linear map / : R n — > R n has no eigenvalues of 



modulus one. Then R(f n ) = N(f n ) =| det(E - f n ) |=| L(f n ) | 0. Thus 
= N(f n ) = (-l) r +P n ■ det(E - f n ), where r is equal to the number 
of Aj G Spec(f) such that | Aj |> 1, and p is equal to the number of fii G 
Spec(f) such that ^ < -1. Consequently, R[f n ) = N(f n ) = (-1)^ ■ L(f n ) 
and the Reidemeister and Nielsen zeta function are rational and equal to 
R f (z) = N f (z) = (L f (a ■ z)) ( ~ 1)r , where a = (-l) p . It follows from the 
results of Franks, Newhouse and Manning |]85| that the following diffeomor- 



phisms g are topologically conjugate to hyperbolic automorphisms of the 
torus V: a Anosov diffeomorphism of the torus, a Anosov diffeomorphism of 
codimension one |S5| of manifold , which is metrically decomposable |[S , 



a Anosov diffeomorphism of a manifold , whose fundamental group is com- 
mutative. Consequently, by the topological conjugacy of g and T, the Nielsen 
zeta function N g (z) is rational and equal to N g (z) = Nr(z) = (Lf(a ■ z)^ 1 ' . 
In this example the Reidemeister and Nielsen zeta functions coincide with 
the Artin-Mazur zeta function. In fact, the covering map F has a unique 
fixed point, which is the origin; hence, by the covering homotopy theorem 
|30H , the fixed points of T are pairwise nonequivalent.The index of each 
equivalence class, consisting of one fixed point, coincides with its Lefschetz 
index, and by the hyperbolicity of T, the later is not equal to zero. Thus 
R(T) = N(T) = F(T). Analogously, J R(r n ) = N(T n ) = F(T n ) for each n> o 
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and Rr(z) = N-p(z) = Fr(z). Since T satisfies axiom A of Smale, by Man- 
ning theorem [34 we get another proof of the rationality of Rr(z) = Nr(z) = 
F T {z). 

let X = RP 2k+ \ k ^ be projective space of odd dimension. Then for 
each n > 0,N(f n ) = 0, if d = 1, and N(f n ) = (2, 1 - d n ), if | d |# I. 
Consequently, N{f n ) = 2, for all n > 0, if | d [^ 1 is odd , and N(f n ) = 1 
for all n > 0, if d is even, and the Nielsen zeta function is rational and equal 
to: 



Nf(z) 



1 



1 

1-2 



if d = 1 

if | ci | 1 is odd 
if d is even. 



Now if d = -1, then for even n,N(f n ) = 0, for odd n,N(f n ) = 2, and 
N f (z) = (1 + z)/(l - 2). For RP 2k } the projective spaces of even dimension, 
one gets exactly the same result for Nf(z). 



Now let / : M — > M be an expanding map[|S6|1 of the orientable smooth 
compact manifold M. Then M is aspherical and is K(tti(M),1) and the 
fundamental group tti(M) is torsion free |5B| . If pr : M — > M is the 
universal covering, / : M — > M is an arbitrary map , covering /, then 
according to Shub [SB] / has exactly one fixed point. From this and the 
covering homotopy theorem []8D] it follows that the fixed points of / are 
pairwise nonequivalent. The index of each equivalence class, consisting of 
one fixed point, coincides with its Lefschetz index,. If / preserves the orien- 
tation of M, then the Lefschetz index L(p, f) of the fixed point p is equal 
to L(p, f) = (— l) r , where r = dimM. Then by Lefschetz trace formula 
R(f) = N(f) = F(f) = (-l) r • L(f) .Since the iterates f n are also orienta- 
tion preserving expanding maps, we get analogously that R(f n ) = N(f n ) = 
F(f n ) = (— l) r ■ L(f n ) for every n, and the Nielsen zeta function is ra- 



tional and equal to Rt 



Friz] 



verses the orientation of the manifold M, then L(p, f n ) 
R(f n ) = N(f n ) = F(f n ) = (-iy+ n ■ L(f n ) and R f (z) 

L f {-z)^r. 



. Now if / re- 
= (-l) r+n . Hence , 
: N f (z) = F f (z) = 
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Example 8 ([§]) Let f : S 2 V S 4 -> S" 2 V S 4 to be a continuous map of the 
bouquet of spheres such that the restriction f / 54 = ids* and the degree of the 
restriction f / '■ S 2 — > S 2 equal to —2. Then L(f) = 0, hence N(f) = since 
S 2 \/S 4 is simply connected. For k > 1 we have L(f k ) = 2+(— 2) k 7^ 0, therefore 
N(f h ) = I. From this we have by direct calculation that 

N f (z)=eM-z)-T^—- (3-19) 

Remark 8 We woidd like to mention that in all known cases the Nielsen 
zeta function is a nice function. By this we mean that it is a product of an 
exponential of a polynomial with a function some power of which is rational. 
May be this is a general pattern; it could however be argued that this just 
reflects our inability to calculate the Nielsen numbers in general case. 



Chapter 4 



Reidemeister and Nielsen zeta 
functions modulo normal 
subgroup, minimal dynamical 
zeta functions 



4.1 Reidemeister and Nielsen zeta functions 
modulo a normal subgroup 

In the theory of (ordinary) fixed point classes, we work on the universal 
covering space. The group of covering transformations plays a key role. It 
is not surprising that this theory can be generalized to work on all regular 
covering spaces. Let K be a normal subgroup of the fundamental group 
tti(X). Consider the regular covering p K : X / K — > X corresponding to K. 
A map fx '■ X/K — > X/K is called a lifting of / : X — > X iip K o f K = fop K . 
We know from the theory of covering spaces that such liftings exist if and 
only if f*(K) C K. If K is a fully invariant subgroup of ni(X) ( in the 
sense that every endomorphism sends K into K) such as, for example the 
commutator subgroup of tti(X), then there is a lifting f K of any continuous 
map /. 

We can develop a theory which is similar to the theory in Chapters I - II 
by simply replacing X and 7Ti(X) by X/K and ni(X)/K in every definition, 
every theorem and every proof, since everything was done in terms of liftings 
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and covering translations. What follows is a list of definitions and some basic 
facts. 

Two liftings fx and f' K are called conjugate if there is a 7^ G T K = 
7r 1 (X)/K such that f' K = ^ K of K o 7- 1 . The subset p^(Fix (f K )) C Fix (/) 
is called the mod K fixed point class of / determined by the lifting class [fx] 
on X/K . The fixed point set Fix (/) splits into a disjoint union of mod K 
fixed point classes. Two fixed points xq and x\ belong to the same mod K 
class iff there is a path c from x to x\ such that c * (/ o c) _1 G K. Each 
mod K fixed point class is a disjoint union of ordinary fixed point classes. 
So the index of a mod K fixed point class can be defined in obvious way. 
A mod K fixed point class is called essential if its index is nonzero. The 
number of lifting classes of / on X/K (and hence the number of mod K 
fixed point classes, empty or not) is called the mod K Reidemeister Number 
of /, denoted KR(f). This is a positive integer or infinity. The number of 
essential mod K fixed point classes is called the mod K Nielsen number of 
/, denoted by KN(f). The mod K Nielsen number is always finite. KR(f) 
and KN(f) are homotopy type invariants. The mod K Nielsen number was 
introduced by G.Hirsch in 1940 , primarily for purpose of estimating Nielsen 
number from below. The mod K Reidemeister zeta functions of / and the 



mod K Nielsen zeta function of / was defined in [24|, |26| as power series 



KR f (z) := exp (f^ KR ^ z n 

\n=l 

/ 00 

KN f (z) := exp £ 



\n=l 



KRf(z) and KNf(z) are homotopy invariants. If K is the trivial subgroup of 
tti(X) then KNf(z) and KRf(z) coincide with the Nielsen and Reidemeister 
zeta functions respectively. 



4.1.1 Radius of Convergence of the mod K Nielsen 
zeta function 

We show that the mod K Nielsen zeta function has positive radius of conver- 
gence. We denote by R the radius of convergence of the mod K Nielsen zeta 
function Nf(z), 
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Theorem 49 Suppose that f : X — > X be a continuous map of a compact 
polyhedron and f*(K) C K. Then 

R > exp(-/i) > (4.1) 

and 

R > =— > 0, (4.2) 

max d \\zF d \\ 

and 

R > L > 0, (4.3) 

m&x d s(F2 orm ) 

where F d and h is the same as in section 3.1.1 and 3.1.2. 

Proof The theorem follows from inequality N(f n ) > KN(f n ) , Caushy- 
Adamar formula and theorems 33 and 34 . 

Remark 9 Let f be a C 1 -mapping of a compact, smooth, Riemannian man- 
ifold M . Then h(f) < log sup \\ Df(x)* \\ fftBJ, where Df(x)* is a mapping 
between exterior algebras of the tangent spaces T(x) andT(f(x)), induced by 
Df(x), || • || is the norm on operators, induced from the Riemann metric. 
Now from the inequality 

h(f) > limsup - • log KN(f n ) 
n n 

and the Cauchy-Adamar formula we have 

1 

R - sup x6M iw)*(*)ir (44) 

4.1.2 mod K Nielsen zeta function of a periodic map 

We denote KN(f n ) by KN n .het /i(d), d 6 N, be the Mobius function 

Theorem 50 Let f be a periodic map of least period m of the connected 
compact polyhedron X and f*(K) C K . Then the mod K Nielsen zeta 
function is equal to 



KNf(z) = J] {/(l-z d )- p ( d \ 

d\m 
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where the product is taken over all divisors d of the period m, and P{d) is 
the integer 

P(d) = J2Kdi)KN dldl . 

di\d 

Proof Since f m = id, for each j,KNj = KN m+j . Since (k,m) = 1, there 
exist positive integers t and q such that kt = mq + 1. So {f k ) 1 = f kt = 
fm q +i = fmgf = (j m y f = f Consequently, KN((f k y) = KN(f). Let two 
fixed point x and X\ belong to the same mod K fixed point class. Then 
there exists a path a from xq to x\ such that a * (f o a)' 1 G K. Since 
f*{K) C K, we have f(a * f o a) -1 ) = (/ o a) * (f 2 o a) -1 G K and a product 
a * (/ o a) -1 * (/ o a) * (f 2 o a) -1 = a * (f 2 o a)~ l G K. It follows that 
a * (f k o a)^ 1 G K is derived by the iteration of this process. So x and x\ 
belong to the same mod K fixed point class of f k . If two point belong to the 
different mod K fixed point classes /, then they belong to the different mod 
K fixed point classes of f k .So, each essential class( class with nonzero index) 
for / is an essential class for f k ; in addition , different essential classes for 
/ are different essential classes for f k . So KN(f k ) > KN(f). Analogously, 
KN(f) = KN((f k Y) > KN(f k ). Consequently , KN(f) = KN(f k ). One 
can prove completely analogously that KN d = KN di) if (i, m/d) =1, where 
d is a divisor of m. Using these series of equal mod K Nielsen numbers, one 
can regroup the terms of the series in the exponential of the mod K Nielsen 
zeta function so as to get logarithmic functions by adding and subtracting 
missing terms with necessary coefficient: 

KN , (Z) = expg™-) 
(„™P{d) z 4 ' 

\d\m 1=1 

= ^p ^f- ■ Ml - z d ) 

\d\m 



= n <K i - zd y p(d) 

d\m 

where the integers P(d) are calculated recursively by the formula 

P(d)=KN d - Yl 



d\\d;d\^d 
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Moreover, if the last formula is rewritten in the form 

KN d = Y,v{di)-P{di) 

d%\d 

and one uses the Mobius Inversion law for real function in number theory, 
then 

P(d) = J2^d 1 )-KN d/dl , 

di\d 

where n(di) is the Mobius function. The theorem is proved. 



4.2 Minimal dynamical zeta function 

4.2.1 Radius of Convergence of the minimal zeta func- 
tion 

In the Nielsen theory for periodic points, it is well known that N(f n ) is 
sometime poor as a lower bound for the number of fixed points of f n . A good 
homotopy invariant lower bound NF n (f), called the Nielsen type number for 
/ n ,is defined in [[yj. Consider any finite set of periodic orbit classes {O kj } 
of varied period kj such that every essential periodic m-orbit class, m\n, 
contains at least one class in the set. Then NF n (f) is the minimal sum J2j % 
for all such finite sets. Halpern (see J51|) has proved that for all n NF n (f) = 



min{#Fix (g n )\g has the same homotopy type as / }. Recently, Jiang j52] 
found that as far as asymptotic growth rate is concerned, these Nielsen type 
numbers are no better than the Nielsen numbers. 

Lemma 28 ([gg]) 

limsup(iV(/ n ))n =limsup(iVF n (/))" (4.5) 

n n 

We define minimal dynamical zeta function as power series 

MM := exp (t N ~^A , 

\n=l n ) 
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Theorem 51 For any continuous map f of any compact polyhedron X into 
itself the minimal zeta function has positive radius of convergence R, which 
admits following estimations 

R > exp(-/i) > 0, (4.6) 

R > — ^- > 0, (4.7) 

max d \\zF d \\ 

and 

R > L > 0, (4.8) 

max d s(F2 orm ) 

where Fd and h is the same as in section 3.1.1 and 3.1.2. 



Proof The theorem follows from Caushy-Adamar formula, lemma 28 and 
theorems 33 and 34. 

Remark 10 Let us consider a smooth compact manifold M , which is a reg- 
ular neighborhood of X and a smooth map g : M —>■ M of the same ho- 
motopy type as f. There is a smooth map <ft '■ M — > M homotopic to g 
such that for every n iteration <p n has only a finite number of fixed points 
F(cj) n )(see $n\j , p. 62). According to Artin and Mazur j^j there exists con- 
stant c = c(0) < oo, such that F((f) n ) < c n for every n > 0. Then due to 
Halperin result c n > F(<ft n ) > NF n (f) for every n > 0. Now the Cauchy- 
Adamar formula gives us the second proof that the radius of the convergence 
R is positive. 



Chapter 5 



Congruences for Reidemeister 
and Nielsen numbers 



5.1 Irreducible Representation and the Uni- 
tary Dual of G 

Let V be a Hilbert space. A unitary representation of G on V is a homomor- 
phism p : G — > U(V) where U(V) is the group of unitary transformations 
of V. Two of these p\ : G — > U(Vi) and p 2 : G — » U(V 2 ) are said to be 
equivalent if there is a Hilbert space isomorphism Vi = V2 which commutes 
with the G-actions. A representation p : G — > U(V) is said to be irreducible 
if there is no decomposition 

V V 1 © v 2 

in which Vi and V 2 are non-zero, closed G-submodules of V. 

One defines the unitary dual G of G to be the set of all equivalence classes 
of irreducible, unitary representations of G. 

If p : G — > U(V) is a representation then p o : G — > U(V) is also a 
representation, which we shall denote (f)(p). If p\ and p 2 are equivalent then 
<p(pi) and 0(p 2 ) are equivalent. Therefore the endomorphism induces a 
map (f) : G — > G from the unitary dual to itself. 

Definition 14 Define the number $Tix(0) to &e the number of fixed points 
of the induced map <fi : G — > G. ILe s/10// writo 5(0) /or £/ie sei of fixed points 
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of<j>. Thus S(<f>) is the set of equivalence classes of irreducible representations 
p : G — > U(V) such that there is a transformation M e U(V) satisfying 

ViGG, p((f)(x)) — M ■ p(x) ■ M _1 . (5.1) 

Note that if is an inner automorphism x i— > gxg~ l then we have for any 
representation p, 

p(0(V)) = p(#) -p(x) -p^) -1 , 

implying that the class of p is fixed by the induced map. Thus for an inner 
automorphism the induced map is trivial and #Fix(0) is the cardinality of 
G. When G is Abelian the group G is the Pontryagin dual of G. 

5.2 Endomorphism of the Direct Sum of a 
Free Abelian and a Finite Group 

In this section let F be a finite group and r a natural number. The group G 
will be the direct sum 

G = Z r ®F 

We shall describe the Reidemeister numbers of endomorphism <fi : G — > G. 
The torsion elements of G are exactly the elements of the finite, normal 
subgroup F. For this reason we have 4>(F) C F.Let (f)f imte \ F — > F be the 
restriction of to F, and let 0°° : G/F — > G/F be the induced map on the 
quotient group. We have proved in proposition 3 that 

#(0) = R((f)f inite ) x #(0°°). 

We shall prove the following result: 
Proposition 4 In £/ie notation described above 

#Fix (0) = #Fix ((f)f inite ) x #Fix (0°°) 

Proof 

Consider the dual G. This is cartesian product of the duals of ZZ r and F: 



G = % r x F, p = pi <g> p 2 
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where pi is an irreducible representation of -ZT and p 2 is an irreducible rep- 
resentation of F. Since Z r is abelian, all of its irreducible representations 
are 1-dimensional , so p(v) for v G Z r is always a scalar matrix, and p 2 is 
the restriction of rho to F. If p — p±® p 2 G 5(0) then there is a matrix T 
such that 

p o (f) = T ■ p ■ T _1 . 

This implies 

pfinite Q ^finite _ rp _ ^finite . j>-1 

so p 2 = pf mtte is in S(4>f' imte ). For any fixed p 2 £ <S(0^ imte ), the set of pi 
with px ® p 2 G S((f)f imte ) is the set of pi satisfying 

p 1 (M-t;)p 2 (^(t;)) = T-p 1 (t;)-T- 1 

for some matrix T independent of v G .ZT. Since pi(i>) is a scalar matrix, 
the equation is equivalent to 

Pi(M-v)p 2 (iJ>(v)) = p 1 (v), 

i.e. 

Pl ((i-M)v)=p 2 y>(v)). 

Note that is isomorphic to the torus T n , and the transformation p\ — > 
pi o (1 — M) is given by the action of the matrix 1 — M on the torus T n . 
Therefore the number of pi satisfying the last equation is the degree of the 
map (1 — M) on the torus , i.e. | det(l — M) |. From this it follows that 

#Fix (0) = #Fix (0 /inite )x | det(l — M) \ . 

As in the proof of proposition 3 we have i?(0°°) =| det(l — M) | .Since 0°° is 
an endomorphism of an abelian group we have #Fix (0°°) = i?(0°°). Therefore 

#Fix (0) = #Fix (ft inite ) x #Fix (0°°). 

As a consequence we have the following 

Theorem 52 // be any endomorphism of G where G is the direct sum of 
a finite group F with a finitely generated free Abelian group, then 

i?(0) = #Fix (0) 
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Proof Let (fif mite is an endomorphism of a finite group F and V be the 
complex vector space of class functions on the group F. A class function is a 
function which takes the same value on every element of a (usual) congruence 
class. The map (frf mite induces a map 

<p : V -»• V 

f ^ focj)f inite 

We shall calculate the trace of <p in two ways. The characteristic functions 
of the congruence classes in F form a basis of V, and are mapped to one 
another by <p (the map need not be a bijection). Therefore the trace of (p is 
the number of elements of this basis which are fixed by ip. By Theorem 14 , 
this is equal to the Reidemeister number. 

Another basis of V, which is also mapped to itself by ip is the set of 
traces of irreducible representations of F (see |60] chapter XVIII). From this 



it follows that the trace of ip is the number of irreducible representations p of 
F such that p has the same trace as 0^ imte (p). However, representations of 
finite groups are characterized up to equivalence by their traces. Therefore 
the trace of ip is equal to the number of fixed points of (ftf mtte . 

So, we have R(<j)f intte ) = #Fix (0^ mte ). Since (f)°° is an endomorphism 
of the finitely generated free Abelian group we have R{<fi°°) = #Fix (0°°) ( 
see formula (2.13) ). It now follows from propositions 3 and 4 that R(<p) = 
#Fix (}). 



Remark 11 By specialising to the case when G is finite and is the iden- 
tity map, we obtain the classical result equating the number of irreducible 
representation of a finite group with the number of conjugacy classes of the 
group. 



5.3 Endomorphism of almost Abelian 
groups 

In this section let G be an almost Abelian and finitely generated group. A 
group will be called almost Abelian if it has an Abelian subgroup of finite 
index. We shall prove in this section an analog of theorem 52 for almost 
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Abelian group founded by Richard Hill [50]. It seems plausible that one 
could prove the same theorem for the so - called "tame" topological groups 
(see |57|]). However we shall be interested mainly in discrete groups, and it 
is known that the discrete tame groups are almost Abelian. 

We shall introduce the profinite completion G of G and the corresponding 
endomorphism : G — > G. This is a compact totally disconnected group in 
which G is densely embedded. The proof will then follow in three steps: 

i?(0) = i?(0), #Fix (0) = #Fix (t), R{4>) = #Fix {%). 

If one omits the requirement that G is almost Abelian then one can still show 
that R{4>) > R{4>) and #Fix (0) > #Fix (0). The third identity is a general 
fact for compact groups (Theorem ^3|) . 



5.3.1 Compact Groups 

Here we shall prove the third of the above identities. 

Let K be a compact topological group and a continuous endomorphism 
of K. We define the number #Fix top (0) to be the number of fixed points of 
in the unitary dual of K, where we only consider continuous representations 
of K. The number i?(0) is defined as usual. 

Theorem 53 ( ||50|| ) For a continuous endomorphism of a compact group 
K one has R{<j>) = #Fix top (0). 

The proof uses the Peter- Weyl Theorem: 

Theorem 54 (Peter - Weyl) // K is compact then there is the following 
decomposition of the space L 2 (K) as a K © K -module. 

l2 ( k ) — Hom c (Vx,V x ). 

and Schur's Lemma: 

Lemma 29 (Schur) IfV andW are two irreducible unitary representations 
then 

Rom CK (V,W) 



V ¥ W 
C V = W. 
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Proof of Theorem [53| The 0-conjugacy classes, being orbits of a 
compact group, are compact. Since there are only finitely many of them, 
they are also open subsets of K and thus have positive Haar measure. 

We embed K in K © K by the map g i— > (g, 4>{g))- This makes L 2 (K) a 
-fT-module with a twisted action. By the Peter- Weyl Theorem we have (as 
i^-modules) 

L 2 (K)= Rom c (V x , V kx) ). 

We therefore have a corresponding decomposition of the space of .fT-invariant 
elements: 

L 2 (K) K =®Kom CK (V x ,V kx) ). 

We have used the well known identity Homc(V, W) K = Hornet (V, W). 

The left hand side consists of functions / : K — > C satisfying f(gxcj)(g)~ 1 ) = 
f(x) for all x,g G K. These are just functions on the 0-conjugacy classes. 
The dimension of the left hand side is thus R{4>)- On the other hand by 
Schur's Lemma the dimension of the right hand side is #Fix top (</>). 



5.3.2 Almost Abelian groups 

Let G be an almost Abelian group with an Abelian subgroup A of finite index 
[G : A]. Let A be the intersection of all subgroups of G of index [G : A]. 
Then A is an Abelian normal subgroup of finite index in G and one has 
4>{A°) C A for every endomorphism <fi of G. 

Lemma 30 If R(<f)) is finite then so is R(4>\ao). 

Proof. A 0-conjugacy class is an orbit of the group G. A 01^0-conjugacy 
class is an orbit of the group A . Since A has finite index in G it follows 
that every 0-conjugacy class in A can be the union of at most finitely many 
01^0-conjugacy classes. This proves the lemma. 

Let G be the profinite completion of G with respect to its normal sub- 
groups of finite index. There is a canonical injection G — ► G and the map 
can be extended to a continuous endomorphism of G. 

There is therefore a canonical map 
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Since G is dense in G, the image of a 0-conjugacy class {x}^ is its closure in 
G. From this it follows that the above map is surjective. We shall actually 
see that the map is bijective. This will then give us 

R(<f>) = R{4>). 

However is an endomorphism of the compact group G so by Theorem 53 

i?(0) = #Fix to P(|). 
It thus suffices to prove the following two lemmas: 
Lemma 31 If R(<p) is finite then #Fix top (|) = #Fix ($). 

Lemma 32 If R(<f)) is finite then the map TZ(<p) — > TZ{4>) is injective. 



Proof of Lemma |3Tj. By Mackey's Theorem (see [p7|), every rep- 
resentation p of G is contained in a representation which is induced by a 
1-dimensional representation \ of A. If p is fixed by <p then for all a G A 



we have x{ a ) = x(0( a ))- Let A 1 = {a ■ <p(a) 1 : a G A }. By Lemma ISO 



.R^l^o) is finite and by Theorem 5 R((f>\^o) = [A : A 1 ]. Therefore A 1 has 
finite index in G. However we have shown that x an d therefore also p is 
constant on cosets of A 1 . Therefore p has finite image, which implies that p 
is the restriction to G of a unique continuous irreducible representation p of 
G. One verifies by continuity that <f)(p) = p. 

Conversely if p G S(4>) then the restriction of p to G is in <S(0). 

Proof of Lemma [32[ We must show that the intersection with G of the 
closure of {x}^ in G is equal to {x}^. We do this by constructing a coset of 
a normal subgroup of finite index in G which is contained in {x}</,. For every 
a G A we have x ~^ xa if there is a b G A with x 1 bx<p(b) 1 = a. It follows 
that {x}<p contains a coset of the group A\ := {x~ l bxcj){b)~ l : b G A }. It 
remains to show that A\ has finite index in G. 

Let V'G?) = x(p(g)x~ 1 . Then by Corollary 4 we have R(ip) = R{4>)- This 
implies R(ip) < oo and therefore by Lemma [ID] that R(iP\a ) < oo. However 
by Theorem 5 we have R(i/j\a ) = [A : A%]. This finishes the proof. 

Theorem 55 ( ||50|| ) If <fi be any endomorphism of G where G is an almost 
abelian group, then 

R{4>) = #Fix (0) 
Proof The proof follows from lemmas 31 , 32 and theorem 53 
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5.4 Endomorphisms of nilpotent groups 

In this section, we shall extend the computation of the Reidemeister num- 
ber to endomorphisms of finitely generated torsion free nilpotent groups via 
topological techniques. Let T be a finitely generated torsion free nilpotent 



group. It is well known |63] that T = tti(M) for some compact nilmanifold 
M. In fact, the rank (or Hirsch number) of T is equal to dimM, the dimen- 
sion of M. Since M is a K(T, 1), every endomorphism : T — > T can be 
realized by a selfmap / : M — > M such that f# = <f> and thus R(f) = R(<j>)- 

Theorem 56 Let T be a finitely generated torsion free nilpotent group of 
rank n. For any endomorphism <fr : T — > T such that R(<f>) is finite, there 
exists an endomorphism ip : /Z n — > Z n such that R(<p) = #Fix ip. 

PROOF: Let / : M — * M be a map realizing on a compact nilmanifold M of 
dimension n. Following H] , M admits a principal torus bundle T — ► M A iV 



such that T is a torus and iV is a nilmanifold of lower dimension. Since every 
selfmap of M is homotopic to a fibre preserving map of p, we may assume 
without loss of generality that / is fibre preserving such that the following 
diagram commutes. 



I I 
M -A M 
Pi lp 
N X N 

A strengthened version of Anosov's theorem || is proven in |TI|] which 
states, in particular, that \L(f)\ = R(f) if L(f) ^ 0. Since the bundle p is 
orientable, the product formula L(f) = L(f b ) ■ L(f) holds and thus yields a 
product formula for the Reidemeister numbers, i.e., R(f) = R(fb) • R(f)- To 
prove the assertion, we proceed by induction on the rank of G or dimM. 

The case where n — 1 follows from the theorem 52 since M is the unit 
circle . To prove the inductive step, we assume that R(f) = #Fix (-0 : 
7r!(T m )(= /% m ) — > 7r 1 (T m )) where m < n and T m is an m-torus. Since 
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R(fb) — #Fix ((j) b : 7Ti(T) — > 7Ti(T)), if L(f) ^ then the product formula 
for Reidemeister numbers gives 

R(f) = #Fix (f b ) ■ #Fix (J) 
= #Fix(^) 

where ^ = fe x $ : tt^T") = m(T) x tt^T™) -> vr^T) x tt^T" 1 ) with 
X" n = T x 

5.5 Main Theorem 

The following lemma is useful for calculating Reidemeister numbers. It will 
also be used in the proof of the Main Theorem 

Lemma 33 Let <fi : G — > G be any endomorphism of any group G, and let 
H be a subgroup of G with the properties 

<f>(H) C H 

Mx eG3nelN such that <f) n {x) G H. 

Then 

R{<t>)=R{<t> H ), 
where <pH '■ H — > H is the restriction of 4> to H. 

Proof Let x E G. Then there is an n such that <p n (x) e H. From 
Lemma 7 it is known that x is 0-conjugate to (f) n (x). This means that the 
0-conjugacy class {x}^ of x has non-empty intersection with H. 

Now suppose that x,y E H are </>-conjugate, ie. there is a <? e G such 
that 

gx = y(f>(g). 

We shall show that x and y are 0#-conjugate, ie. we can find a g e H 
with the above property. First let n be large enough that 4> n (g) £ H . Then 
applying <p n to the above equation we obtain 



PigWW = <t> n {y)<t> n+1 {g)- 
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This shows that <fi n (x) and <fi n {y) are ^//-conjugate. On the other hand, one 
knows by Lemma 7 that x and <p n (x) are ^//-conjugate, and y and (p n (y) are 
4>h conjugate, so x and y must be ^//-conjugate. 

We have shown that the intersection with H of a 0-conjugacy class in G 
is a 0#-conjugacy class in H. We therefore have a map 

.Rest : TZ(<p) -> 7e(0 H ) 

This clearly has the two-sided inverse 

fa}** ^ fa}*- 
Therefore Rest is a bijection and R(4>) = R(4>h)- 

Corollary 19 Let H = (j) n (G). Then R(<f>) = R(<p H )- 

Let fJ,(d), d G IN be the Moebius function, i.e. 

f 1 if d = 1, 

M^) = ■{ ( — if <i is a product of distinct primes, 
[ if d is not square — free. 

Theorem 57 (Congruences for the Reidemeister numbers) Let<p '■ G 
^ G be an endomorphism of the group G such that all numbers R(<fi n ) are 
finite and let H be a subgroup of G with the properties 

4>{H) C H 

Vx G G 3n G IN such that <f) n (x) G H. 

If one of the following conditions is satisfied: 

(I) H is finitely generated Abelian, 

(II) H is finite, 

(III) H is a direct sum of a finite group and a finitely generated free Abelian 
group, 

or more generally 

(IV) H is finitely generated almost Abelian group, 
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or 



(V) H is finitely generated, nilpotent and torsion free , then one has for all 
natural numbers n, 



£>(d) -R{(t> n,d ) = mod 

d\n 



71. 



Proof From theorems 52, 55, 56 and lemma 33 it follows immediately 
that , in cases I - IV, for every n 

R((f) n ) = #Fix [<f H n :H^H 

Let P n denote the number of periodic points of (fin of least period n. One 
sees immediately that 

i?(<T) = #Fix U H n ]=J2P d - 



Applying Mobius' inversion formula, we have, 

p n = j2MR(r /d )- 

d\n 

On the other hand, we know that P n is always divisible be n, because P n is 
exactly n times the number of 0^-orbits in H of length n. In the case V when 
H is finitely generated, nilpotent and torsion free ,we know from theorem 56 
that there exists an endomorphism if) : Z n — > Z n such that R(<f) n ) = #Fix if) n . 
The proof then follows as in previous cases. 

Remark 12 For finite groups, congruences for Reidemeister numbers follow 
from those of Bold for Lefschetz numbers since we have identified in remark 2 
the Reidemeister numbers with the Lefschetz numbers of induced dual maps. 



5.6 Congruences for Reidemeister numbers 
of a continuous map 

Using corollary 1 we may apply the theorem 57 to the Reidemeister numbers 
of continuous maps. 
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Theorem 58 Let f : X — > X be a self-map such that all numbers R(f n ) 
are finite. Let /* : ni(X) — > iri(X) be an induced endomorphism of the group 
tti(X) and let H be a subgroup of tti(X) with the properties 

f*(H)GH 

Mx G 7Ti(X) 3n G IV such that f™(x) G H. 

If one of the following conditions is satisfied : 

(I) H is finitely generated Abelian, 

(II) H is finite, 

(III) H is a direct sum of a finite group and a finitely generated free Abelian 
group 

or more generally, 

(IV) H is finitely generated almost Abelian group, 
or 

(V) H is finitely generated, nilpotent and torsion free , 
then one has for all natural numbers n, 

^2n(d)-R(f n/d ) ee mod n. 

d\n 

5.7 Congruences for Reidemeister numbers 
of equivariant group endomorphisms 

Let G be a compact Abelian topological group acting on a topological group 
7T as automorphisms of n, i.e., a homomorphism v : G — > Aut(ir). For every 
a G 7i, the isotropy subgroup of a is given by G a = {g G G\g(a) = a} where 
g{a) = v(g)(a). For any closed subgroup H < G, the fixed point set of the 
ff-action, denoted by 

7T H — {(7 G n\h(a) =a,Vhe H}, 

is a subgroup of n. Since G is Abelian, G acts on n 11 as automorphisms of 
n H . Denote by C(n) (and C(n H )) the set of conjugacy classes of elements 
of 7r (and rr H , respectively). Note that the group G acts on the conjugacy 
classes via 

< a >h^< g(a) > 
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for < a >G C(tt) (or C(n H )). 

Let Endci^) ^ e the se ^ °f G-equivariant endomorphisms of ir. For any 
G End G {-K) and H <G, (f) H e End G (-K H ) where H = 0|tt h : tt^ -> tt^. 
Furthermore, induces a G-map on C(n) defined by 

4>conj ■ C{jl) -> C(7r) 

< cr >f-^< 0(cr) > . 
(<p H ) conr .C(n H )^C(n H ). 



via 



Similarly, H induces 



In the case where 7r is Abelian, G acts on ir via 

for any x £ tt, g G G. Thus the dual of G Endc(7i) is also G-equivariant, 
i.e., G Endcin). Similarly, (fi H G Endc(n H ). 

To establish the congruence relations in this section, we need the following 
basic counting principle. 

Lemma 34 Let G be an Abelian topological group and V be a G-set with 
finite isotropy types. For any G-map ip : T — > T, 

Fix -0 = |_| Fix ip K 

KeIso(F) 

where Iso(T) is the set of isotropy types ofT, T K = {7 G T\G 7 = K},ip K = 
i/j\F k : T K ^ T K and Fix ip K = (Fix ip)nT K . In particular, i/#Fix -0 < 00 
then 

#Fix^= E #Fix^- (5-2) 

ife/so(r) 
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PROOF: It follows from the decomposition 

r= U t k .d 

K£lso(T) 



Remark Suppose that G is a compact Abelian Lie group. If Fix ip is finite 
then it follows that #Fix ipx = I{iPk), the fixed point index of ipx which is 



divisible by x(G/K), the Euler characteristic of G/K (see | T9fl , [Q, |]9^ 



Theorem 59 Let G be an Abelian compact Lie group. For any subgroup 
H G Iso(tt) and <fi G Endcin), if 

(I) 7i is finitely generated and <fi is eventually commutative or 

(II) 7r is finite or (III) ti is finitely generated torsion free nilpotent, then 

]T i2(H,K)R((f) K ) =0 mod X (G/H) 

H<K&Iso(tt) 

and 

E V(H,K)R(<P K ) = mod X {G/H) 

H<K£lso(n) 

where ) denotes the Mobius junction on Iso(tt) and 
<p(H,K)= £ X (L/H)v(L,K). 

H<L<K 

PROOF: (I): Since <fi is eventually commutative, so is 4> H for every H < G. 
With the canonical G-action on Hx(tt), Hi(<f>) is a G-equivariant endomor- 
phism of Hi{tx). Similarly, we have H\{(j) H ) G Endo(Hi(7T H )) and hence 
H\(4> H ) G Endo(H i(tt h )) ■ It follows from theorem 52 and formula (5.1) that 

R^) = #Fix (HW*)) = E # Fix (HA$ h ))k. 

H<KeIso(w) 

Hence, by Mobius inversion 0, we have 



E ^) W) = # Fix (#i(<Oh = mod x(G/#). 

_ff<i<'ei"so(7r) 
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(II) : Following theorem 14 , we have 

R{(t> H ) = #Fix (<f) H ) conJ = Yl # FiX ((<P H )conj)K- 

H<K£Iso(tt) 

The assertion follows from formula (5.1) and the Mobius inversion for- 
mula. 

(III) : The commutative diagram in the proof of Theorem 56 gives rise to the 
following commutative diagram in which the rows are short exact sequences 
of groups where tx' is free abelian and fx is nilpotent. 

i / i* P* - i 

1 — > 7T — > TX — > TX ^ 1 

W U U 

1 , U p* -, 

1 — > tx — > tx — > IX — > 1 

Note that G acts on both tx' and fx as automorphisms and so 0' and 
4> are both G-equivariant. Similarly, we have <p' H G Endc{Tx' H ) and cf) H G 
Endc{(t) H ) ■ It follows from the proof of Theorem 56 that the endomorphism 
ip can be made G-equivariant by the diagonal action on the product of the 
fibre and the base. Hence, 

R(<P H ) = #Fix $3= Yl # Fix (^V 

H<K£ Iso(tt) 

Again, the assertion follows from Mobius inversion. 

Finally, for the congruences with ip(,), we proceed as in Theorem 6 of 
0- □ 

Remark 13 In fi5$] , Komiya considered the G-invariant set X^ H ' = GX H 
for arbitrary G (not necessarily Abelian). In our case, tx^ h > need not be a 
subgroup of tx. For example, take tx = G = S3 to be the symmetric group on 
three letters and let G act on tx via conjugation. For any subgroup H < G of 
order two, it is easy to see that tx^ h ' is not a subgroup of tx. 
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5.8 Congruences for Reidemeister numbers 
of equivariant maps 



Unlike Komiya's generalization |59[ of Dold's result, the congruence rela- 
tions among the Reidemeister numbers of f n established in section cannot 
be generalized without further assumptions as we illustrate in the following 
example. 

Example 9 Let X = S 2 C R 3 , G = Z 2 act on S 2 via 

C(x 1 ,x 2 ,x 3 ) = (x 1 ,x 2 ,(x 3 ) 

S 1 . Let / 

It follows that 



so that X G = S 1 . Let / : X — > X be defined by (xi,X2,Xs) i— > (—xx,X2,X3). 



R(f) = 1; R(f G ) = 2. 

Hence 

E MW, = W) + ^(2)^(/ G ) = - 1 

(1)<K 

which is not congruent to mod 2. 

In order to apply the previous result , we need R(f H ) = R((f*) H ), for all 
H < G. In the above example, R(f G ) = 2 but R((f*) G ) = 1. 

Recall that a selfmap / : X — > X is eventually commutative [^T[j if the 
induced homomorphism /„ : 7Ti(X) — > 7Ti(X) is eventually commutative. The 
following is immediate from Theorem 59. 

Theorem 60 Let j : X X be a G-map on a finite G-complex X where 
G is an abelian compact Lie group, such that X H is connected for all H e 
Iso(X). If f is eventually commutative, orrr^X 11 ) is finite or nilpotent, and 
R(f H ) = R((f*) H ) for all H G Iso(X), then 

E ti(H,K)R(f K )=0 mod X (G/H) 

H<K£Iso(tt) 

and 

E <p(H,K)R(f K ) = mod X (G/H). 

H<K£lso(n) 
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5.9 Congruences for Nielsen numbers of a con- 
tinuous map 

Theorem 61 Suppose that there is a natural number m such that /™(7r) C 
I(f m ) ■ If for every d dividing a certain natural number n we have L(f n ^ d ) ^ 
0, then one has for that particular n, 

Y,Kd)N{f n/d ) = 0mod n. 

d\n 

Proof From the results of Jiang |5T| we have that N(f n/d ) = R(f n/d ) for 
the same particular n and f* is eventually commutative. The result now 
follows from theorem 58. 

Corollary 20 Let I(idx) = tt and for every d dividing a certain natural 
number n we have L(f n ^ d ) ^ 0, then theorem 61 applies 

Corollary 21 Suppose that X is aspherical, f is eventually commutative 
and for every d dividing a certain natural number n we have L(f n / d ) ^ 0, 
then theorem 61 applies 

Example 10 Let f : T n —>■ T n be a hyperbolic endomorphism. Then for 
every natural n 

Y,^(d)N(f n/d ) = 0mod n. 

d\n 

Example 11 Let g : M — > M be an expanding map j^by of the orientable 
smooth compact manifold M. Then M is aspherical and is a K(tti(M), 1), and 
7Ti(M) is torsion free ft86\j. According to Shub fi86}] any lifting g of g has exactly 
one fixed point. From this and the covering homotopy theorem it follows that 
the fixed point of g are pairwise inequivalent. The same is true for all iterates 
g n . Therefore N(g n ) = #Fix (g n ) for all n.So the sequence of the Nielsen 
numbers N(g n ) of an expanding map satisfies the congruences as above. 
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Theorem 62 Let X be a connected, compact polyhedron with finite funda- 
mental group 7i. Suppose that the action of it on the rational homology of 
the universal cover X is trival, i.e. for every covering translation a G n, 
a* = id : H*(X,Q) — > H t (X,Q). If for every d dividing a certain natural 
number n we have L(f n / d ) ^ 0, then one has for that particular n, 

Y,Kd)N{f n/d ) = 0mod n. 

d\n 



Proof From the results of Jiang |5T[ we have that N(f n l d ) = R(f n / d ) for 
the same particular n.The result now follows from theorem 58. 

Lemma 35 Let X be a polyhedron with finite fundamental group tc and let 
p : X — > X be its universal covering. Then the action of it on the rational 
homology of X is trivial iff H*(X; Q) = H*(X; Q). 



Corollary 22 Let X be a compact 1- connected polyhedron which is a rational 
homology n-sphere, where n is odd. Let n be a finite group acting freely on 
X and let X = X/tt. Then theorem 62 applies. 

Proof The projection p : X — > X = X /ir is a. universal covering space of 
X. For every a G 7r, the degree of a : X — > X must be 1, because L(a) = 
(a has no fixed points). Hence a* = id : H*(X; Q) H*(X; Q). 

Corollary 23 If X is a closed 3-manifold with finite n, then theorem 62 
applies. 

Proof X is an orientable, simply connected manifold, hence a homology 
3- sphere. We apply corollary 22. 

Example 12 Let X = L(m,qi, . . . ,q r ) be a generalized lens space and f : 
X — >• X a continuous map with /i*(l) = k where | k |^ 1. Then for every 
natural n 

Y,^(d)N(f n/d ) = 0mod n. 

d\n 
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Proof 

By corollary we see that theorem applies for lens spaces. Since 7Ti(X) = 
Z/mZ, the map / is eventually commutative. A lens space has a structure 
as a CW complex with one cell e, in each dimension < % < 2n + 1. The 
boundary map is given by de 2 k = fn-^k-i f° r even cells, and de 2 k+i = for 
odd cells. From this we may calculate the Lefschetz numbers: 

L(f n ) = 1 - k {l+1)n ^ 0. 

This is true for any n as long as | k \^ 1. The result now follows from 
theorem . 

Remark 14 It is known that in previous example 

N(f n ) = R(f n ) = #Coker (1 - /») = hcf(l - k n ,m) 

for every n.So we obtain pure arithmetical fact: the sequence n i— > hcf{\ — 
k n , m) satisfies congruences above for every natural n if \ k \^ 1. 



5.10 Some conjectures for wider classes of 
groups 

For the case of almost nilpotent groups (ie. groups with polynomial growth, 
in view of Gromov's theorem [Q) we believe that the congruences for the 
Reidemeister numbers are also true. We intend to prove this conjecture by 
identifying the Reidemeister number on the nilpotent part of the group with 
the number of fixed points in the direct sum of the duals of the quotients 
of successive terms in the central series. We then hope to show that the 
Reidemeister number of the whole endomorphism is a sum of numbers of 
orbits of such fixed points under the action of the finite quotient group (ie 
the quotient of the whole group by the nilpotent part). The situation for 
groups with exponential growth is very different. There one can expect the 
Reidemeister number to be infinite as long as the endomorphism is injective. 



Chapter 6 

The Reidemeister torsion 



6.1 Preliminaries 

Like the Euler characteristic, the Reidemeister torsion is algebraically de- 
fined. Roughly speaking, the Euler characteristic is a graded version of the 
dimension, extending the dimension from a single vector space to a complex 
of vector spaces. In a similar way, the Reidemeister torsion is a graded ver- 
sion of the absolute value of the determinant of an isomorphism of vector 
spaces: for this to make sense, both vector spaces should be equipped with 
a positive density. 

Recall that a density / on a complex space V of dimension n is a map 
/ : A n V -> R with /(A • x) = |A| • f(x) for all x E A n V, A G <D. The 
densities on V clearly form a real vector space |V| of dimension one. If / is 
nonzero and takes values in [o, oo), we say that it is positive . If V\ and V 2 
are both n-dimensional and A : V\ — > V 2 is linear over (T, then there is an 
induced map A* : \V 2 \ — > |Vi|. If each Vi carries a preffered positive density 
fi then A*f 2 — a • fi, for some a > 0, and we write a = \detA\In the case 
Vi — V2, fi — J 2 then a is indeed the absolute value of the determinant of A, 
so this notation is consistent. 

If — > V\ — > V 2 — > V3 — > is an exact sequence of finite dimensional 
vector spaces over (T , then there is a natural isomorphism A ni Vi <g) A n3 V3 — > 
A n2 V 2 , nj = dimVi. This induces a natural isomorphism |Vi| <8> \V 3 \ = \V 2 \. If 
V is zero, then absolute value is a standard generator for \V\ and sets up a 
natural isomorphism |V| = R. 
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Let d 1 : C l — > C l+1 be a cochain complex of finite-dimensional vector 
spaces over (F with C % = for % < or z large. Let = kerd 1 , B % = 
imd 1-1 , and if* = Z l / B l be the cocycles, coboundaries, and cohomology of 
C* respectively. If one is given positive densities A; on C l and Di on H l {Wit\\ 
the standard choice when i is negative or large), then the Reidemeister torsion 
r(C*, Aj, Dj) G (0, oo) is defined as follows. The short exact sequences — > 
Z l -»• C* -> -»• and -> S j -> Z l -> -> o together with the 

trivializations \C l \ — R • A$, \H % \ = R - give isomorphisms ® = 
i? ; | B l | = |Z l | for each i. This gives isomorphisms \B l \ ® = i?, hence 

also \B l \ ^ |B*+ 2 |. But for i < or i large, = and so = i?. So 
if j is large and even, we find i? = \B^\ = \B°\ = R and this isomorphism 
is the multiplication by scalar r G R*. This is the Reidemeister torsion 
r(C*,A h D t ). 

If the cohomology H % = for all i we say that C* is acyclic and we write 
t(C*, Aj) for the torsion when all the _Dj are standard . 
When C* is acyclic , there is another way to define r. 

Definition 15 Consider a chain contraction 5 l : C % — > C 4 ^ 1 , ie. a linear 
map such that doS + 5od = id. Then d + 5 determies a map 

(d + 5)+ : C+ := ®C 2i -> C" := ©C 2m and a map (d + 5)_ : C~ -> C+. 
S'znce the map (d+5) 2 = id+5 2 is unipotent, (d+S) + must be an isomorphism. 
One defines r(C*,Ai) :=\ det(d + 5) + \ (see jgQj). 

Reidemeister torsion is defined in the following geometric setting. Sup- 
pose if is a finite complex and E is a flat, finite dimensional, complex vector 
bundle with base K. We recall that a flat vector bundle over K is essentially 
the same thing as a representation of tt\(K) when K is connected. If p G K is 
a basepoint then one may move the fibre at p in a locally constant way around 
a loop in K. This defines an action of TTi(K) on the fibre E p of E above p. We 
call this action the holonomy representation p : 7r — > GL(E P ). Conversely, 
given a representation p : 7r — > GL(V) of 7r on a finite dimensional complex 
vector space V, one may define a bundle E = E p = (K xV)/ir. Here if is the 
universal cover of K, and 7r acts on K by covering tranformations and on V 
by p. The holonomy of £/ p is p, so the two constructions give an equivalence 
of flat bundles and representations of ir. 

If K is not connected then it is simpler to work with flat bundles. One 
then defines the holonomy as a representation of the direct sum of tti of the 
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components of K. In this way, the equivalence of flat bundles and represen- 
tations is recovered. 

Suppose now that one has on each fibre of E a positive density which is 
locally constant on K. In terms of pe this assumption just means | det Pe\ = 
1. Let V denote the fibre of E. Then the cochain complex C l (K;E) with 
coefficients in E can be identified with the direct sum of copies of V associated 
to each i-cell a of K. The identification is achieved by choosing a basepoint 
in each component of K and a basepoint from each i-cell. By choosing a flat 
density on E we obtain a preferred density Aj on C l (K, E). Let H l (K; E) be 
the i-dimensional cohomology of K with coefficients in E , i.e. the twisted 
cohomology of E. Given a density Di on each H l (K;E), one defines the 
Reidemeister torsion of (K; E, A) to be t(K; E, A) = r(C*(K; E), A;, A) e 
(0, oo). A case of particular interest is when E is an acyclic bundle, meaning 
that the twisted cohomology of E is zero (H l (K; E) = 0), then one can take 
A to be the absolute value map on A°(0) = W and the resulting Reidemeister 
torsion is denoted by r(K; E). In this case it does not depend on the choice 
of flat density on E. 

The Reidemeister torsion of an acyclic bundle E on K has many nice 
properties. Suppose that A and B are subcomplexes of K. Then we have a 
multiplicative law: 

t(A UB;E)- t(A f]B;E)= r(A; E) ■ r(B; E) (6.1) 

that is interpreted as follows. If three of the bundles E\A U B, E\A n 
B, E\A, E\B are acyclic then so is the fourth and the equation (6.1) holds. 

Another property is the simple homotopy invariance of the Reidemeister 
torsion. Suppose K' is a subcomplex of K obtained by an elementary collapse 
of an n-cell a in K. This means that K = K' U a U a' where a' is an (n — 1) 
cell of K so set up that da' — a' D K' and a' C da, i.e. a' is a free face of a. 
So one can push a' through a into K 1 giving a homotopy equivalence. Then 
H*(K;E) = H*(K';E) and 

r(K;E,D l ) = r(K';E,D t ) (6.2) 

By iterating a sequence of elementary collapses and their inverses, one obtains 
a homotopy equivalence of complexes that is called simple . Plainly one 
has, by iterating (6.2) , that the Reidemeister torsion is a simply homotopy 
invariant. In particular r is invariant under subdivision. This implies that 
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for a smooth manifold, one can unambiguously define t(K; E, Di) to be the 
torsion of any smooth triangulation of K. 

In the case K = S 1 is a circle, let A be the holonomy of a generator of the 
fundamental group 7r 1 (S' 1 ). One has that E is acyclic iff / — A is invertible 
and then 

r(S' 1 ; E) =| det(7 - A) | (6.3) 

Note that the choice of generator is irrelevant as / — A^ 1 = (— A _1 )(J — A) 
and {deti-A^l = 1. 

These three properties of the Reidemeister torsion are the analogues of 
the properties of Euler characteristic ( cardinality law, homotopy invariance 
and normalization on a point), but there are differences. Since a point has no 
acyclic representations (H° ^ 0) one cannot normalise r on a point as we 
do for the Euler characteristic, and so one must use S 1 instead. The multi- 
plicative cardinality law for the Reidemeister torsion can be made additive 
just by using log r , so the difference here is inessential. More important for 
some purposes is that the Reidemeister torsion is not an invariant under a 
general homotopy equivalence: as mentioned earlier this is in fact why it was 
first invented. 

It might be expected that the Reidemeister torsion counts something 
geometric (like the Euler characteristic). D. Fried showed that it counts the 
periodic orbits of a flow and the periodic points of a map. We will show that 
the Reidemeister torsion counts the periodic point classes of a map( fixed 
point classes of the iterations of the map). 

Some further properties of r describe its behavior under bundles. 

Let p : X — > B be a simplicial bundle with fiber F where F, B, X are 
finite complexes and p~ x sends subcomplexes of B to subcomplexes of X . 
over the circle S 1 . We assume here that E is a flat, complex vector bundle 
over B . We form its pullback p*E over X. Note that the vector spaces 
H l (p~ l (b), W) with b G B form a flat vector bundle over B, which we denote 
H l F. The integral lattice in H l {p~~ 1 {b) ) IR) determines a flat density by the 
condition that the covolume of the lattice is 1. We suppose that the bundle 
E <S> H l F is acyclic for all i. Under these conditions D. Fried 0] has shown 
that the bundle p*E is acyclic, and 



t(X; p*E) = J] t(B; E ® WF)^ 

i 



(6.4) 
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the opposite extreme is when one has a bundle E on X for which the restric- 
tion E\F is acyclic. Then, for B connected, 

t(X;E) = r(F;E\F) x(B ^ (6.5) 

Suppose in (6.5) that F = S l i.e. X is a circle bundle . Then (6.5) can be 
regarded as saing that 

log t(X;E) = X (B)- log t(F;E\F) 

is counting the circle fibers in X in the way that x counts points in B, with 
a weighting factor of log r(F; E\F). 



6.2 The Reidemeister zeta Function and the 
Reidemeister Torsion of the Mapping To- 
rus of the dual map. 

Let / : X — > X be a homeomorphism of a compact polyhedron X. Let 
Tf := (X x I)/(x, 0) ~ (f(x), 1) be the mapping tori of /. We shall consider 
the bundle p : Tf — > S 1 over the circle S 1 . We assume here that E is a 
flat, complex vector bundle with finite dimensional fibre and base S 1 . We 
form its pullback p*E over Tf. Note that the vector spaces if ? (p _1 (&), c) with 
b G S 1 form a flat vector bundle over S 1 , which we denote H l F. The integral 
lattice in H l (p~ l (b), H) determines a flat density by the condition that the 
covolume of the lattice is 1. We suppose that the bundle E ® H l F is acyclic 



for all i. Under these conditions D. Fried |42| has shown that the bundle p*E 
is acyclic, and we have 

T(T f ;p*E) =Y[t(S 1 ; E ® H'Fy- 1 ^ . (6.6) 

i 

Let g be the prefered generator of the group vri(S' 1 ) and let A = p(g) where 
p : 7r 1 (S' 1 ) — > GL(V). Then the holonomy around g of the bundle ® fPF 

is A®/;. 

Since r(S' 1 ; £?) =| det(J — A) | it follows from (6.6) that 

r(T f ;p*E) = ]J | det(J — A® /*) l^ 1 ) 1 . (6.7) 
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We now consider the special case in which E is one-dimensional, so A is just 
a complex scalar A of modulus one. Then in terms of the rational function 
L f (z) we have @: 

riT f -fE) = J] I det(J - A • /*) L f (X) \~ l (6.8) 

i 

Theorem 63 Let <p : G — > G be an automorphism of G , where G is the direct 
sum of a finite group with a finitely generated free Abelian group, then 

r fop'E) =\ L $ (X) \-'=\ R^(a ■ A) |(-^ + \ (6.9) 

where A is the holonomy of the one- dimensional fiat complex bundle E over 
S 1 , r and o are the constants described in theorem 13 . 

Proof We know from the theorem 52 that R(<j) n ) is the number of fixed 
points of the map <f) n . In general it is only necessary to check that the number 
of fixed points of n is equal to the absolute value of its Lefschetz number. 
We assume without loss of generality that n = 1. We are assuming that R((p) 
is finite, so the fixed points of form a discrete set. We therefore have 

L{4>) — 51 Index (4>,x). 

Since is a group endomorphism, the trivial representation x £ G is always 
fixed. Let x be any fixed point of 0. Since G is union of tori Go, G t and 
is a linear map, we can shift any two fixed points onto one another without 
altering the map <fi. This gives us for any fixed point x the equality 

Index (0, x) = Index (0, x ) 

and so all fixed points have the same index. It is now sufficient to show that 
Index (0, Xq) = ±1. This follows because the map on the torus 

: Go — > Go 

lifts to a linear map of the universal cover, which is an euclidean space. The 
index is then the sign of the determinant of the identity map minus this 
lifted map. This determinant cannot be zero, because 1 — must have finite 
kernel by our assumption that the Reidemeister number of is finite (if 
det(l — 0) = then the kernel of 1 — is a positive dimensional subspace of 
G, and therefore infinite). 
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Corollary 24 Let f : X — > X be a homeomorphism of a compact polyhedron 
X. If Hi(X) is the direct sum of a finite group with a free Abelian group, 
then then 







-l 










R f (a • A) 



where r and o are the constants described in theorem 13 . 

6.3 The connection between the Reidemeis- 
ter torsion, eta— invariant, the Rochlin in- 
variant and theta multipliers via the dy- 
namical zeta functions 

In this section we establish a connection between the Reidemeister torsion 
of a mapping tori, the eta- invariant, the Rochlin invariant, and theta multi- 
pliers via the Lefchetz zeta function and the Bismut-Freed-Witten holonomy 
theorem. 

6.3.1 Rochlin invariant 

We begin by recalling the definition of a spin structure on an oriented Rie- 
mannian manifold M m with special attention to the notion of a spin diffeo- 
morphism. The tangent bundle TM is associated to a principal GL + (m) 
bundle P, the bundle of oriented tangent frames. This last group GL + (m) 
has a unique connected two-fold covering group GL + {m). If the tangent 
bundle TM is associated to a princial GL + (m) bundle P, then we call P a 
spin structure on M. Thus, spin structures are in one-to-one correspondence 
with double coverings P — > P which are nontrivial on each fiber. In terms of 
cohomology, such coverings are given by elements w of such 
that w | 7r _1 (a;) = for every x in M, where n : P — > M is the bundle 
projection and 7r _1 (a;) is the fiber over x. We shall refer to the cohomology 
class w as a spin structure on M, and the pair (M, w) as a spin manifold. 

Given an orientation preserving diffeomorphism / : M — > M, the differen- 
tial df of / gives us a diffeomorphism df : P — > P and hence an isomorphism 
on the cohomology (df)* : H 1 (P,%/2%) -> H\P,Z/2Z). We say that an 
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orientation-preserving diffeomorphism / : M — > M preserves the spin struc- 
ture w if (df)*(w) = w in Z/2Z). This is equivalent to the existence 
of a bundle map b : P — > P making the following diagram commutative 

P ± P 
I I 
P % P 

By a spin diffeomorphism F of (M, w) we mean a pair F = (/, 6) consisting 
not only of a spin preserving diffeomorphism / but also of a bundle map 
b : P — > P covering df. Given a spin diffeomorphism F = (f,b) of (M,w) 
there is a well defined spin structure w' on the mapping torus Tf (see [|61|j). 

We shall now define an invariant of spin diffeomorphisms F of (M, w) 
where M has dimension 8k + 2. This will actually be defined via (Tf,w'), 
a spin manifold of dimension 8k + 3. As usual, a spin manifold (N 8k+3 ,w) 
is a spin boundary if there is a compact 8k + 4-dimensional spin manifold 
(X m+i , W) with <9X = iV and with W restricting to w. By a result of @ 
the manifold jV 8fc+3 is a spin boundary if and only if it is an unoriented 
boundary A necessary and sufficient condition for iV to be a boundary is 
that all its Stiefel- Whitney numbers vanish. In particular, this is always 
the case when k = or k = 1. If M 8h+2 has vanishing Stiefel- Whitney 
classes, then all the Stiefel- Whitney numbers of Tf are zero (see ||61|| ). For a 
spin boundary (N 8k+3 ,w) = d(X sk+4 ,W) the Rochlin invariant R(N,w) in 
X/16X is defined by 

i2(iV, w) = a{X) (mod 16), 
where cr(X) denotes the signature of the 8k + 4-dimensional manifold X. 

6.3.2 Determinant line bundles, the Eta-invariant and 
the Bismut-Freed-Witten theorem 

Let 7r : Z — ► iV be a smooth fibration of manifolds with base manifold iV and 
total manifold Z. The fiber above a point x G iV is an 8k + 2-dimensional 
manifold M 8k+2 which is equipped with a metric and a compatible spin struc- 
ture. The latter vary smoothly with respect to the parameter x in the base 
manifold; in other words the structure group of the fibration 7r : Z — * iV is a 
subgroup of the spin diffeomorphism group. 
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In this situation, along a fiber M x , we have a principal Spin(8k + 2)- 
bundle P(TM X ). Since the dimension 8A; + 2 is even there are two half- 
spin representation S± of Spin(8k + 2) and associated to them two vector 
bundles E% = P{TM X ) ®S ± . On the space C°°(E±) of C°°-sections of these 
bundles, there is a Dirac operator d x : C°°{E^) — > C°°(E^) which is a first 



order, elliptic, differential operator fL8| . If we replace the C^-sections of 
by square-integrable sections, the Dirac operator can be extended to an 
operator d x : L 2 {E^) — > L 2 {E^) of Hilbert spaces. As we vary x over N, 
these Hilbert spaces L 2 (E^) form Hilbert bundles L 2 {E ± ) and the operators 
d x form a continuous family of operators d : L 2 (E^) — > L 2 (E T ) on these 
Hilbert bundles. 

From the work Atiyah-Singer, Bismut-Freed |J and Quillen |7B[ it follows 
that there exists a well-defined complex line bundle det d over N. Over a 
point x in N, the fiber of this line bundle (det d) x is isomorphic to 
(A max kerd x )* (8)(A max cokerd x ). Bismut and Freed || undertook an extensive 
study of the geometry of this determinant line bundle det d. They showed 
that det d admits a Bismut-Freed connection y, and proved a formula for 
the curvature associated to this connection. One of the basic results in is 
the holonomy formula for the Bismut-Freed connection y of the determinant 
line bundle det d around an immersed circle 7 : S 1 — > iV in the base manifold 
N. We now describe this formula. Pulling back by 7, there is an 8k + 3- 
dimensional manifold which is diffeomorphic to a mapping torus T^, with the 
diffeomorphism specified by 7. Choosing an arbitrary metric on S 1 , 
and using the projection $ : r(T^) — > Ty^e^T^) of tangent bundles, we obtain 
a Riemannian structure on T^. Since the structure group of the fibration 
7r : Z — > iV is a subgroup of the spin diffeomorphism group, it follows that <p 
is covered by a canonical spin diffeomorphism and the mapping torus has 
a natural spin structure. From this spin structure on we obtain a spin 
bundle over with structure group Spin(8k + 3) and Dirac operator d on 
the space of C^-sections of this bundle. 

Following Atiyah, Patodi, Singer we define the function rj(s, d) in terms 
of the eigenvalues A of d by 

»M = £^. 

This function is holomorphic for Re(s) > and its value at s = is the 
77-invariant of d: r](d) = r](0,d). We denote by h(d) the dimension of the 
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kernel of the operator d. Notice that these invariants depend on the choice 
of the metric ggi on the base circle S 1 . In order to be free of this choice, we 
scale the metric ggi by a factor \, and with respect to this new metric 
we have a Dirac operator d e on and a corresponding ^-invariant r](d e ) and 
h(d e ). As the parameter e tends to zero, the invariant v(d<i)+h(d c ) ^ enc [ s ^ Q a 
fixed limit. 

Theorem 64 j^j The holonomy of the Bismut-Freed connection y of the 
determinant line bundle det d around 7 is given by 



Now, suppose that tt : Z — > N is a fibration of manifolds M 8k+2 with 
two prefered spin structures Wi and w 2 - Corresponding to these two spin 
structures, there are families of Dirac operators d m and d W2 , and determinant 
line bundles det d wi and det d W2 . Notice that from the curvature formula of 
Bismut-Freed M these two complex line bundles det d Wl and det d W2 have 
the same curvature 2- form. Hence if we form the bundle det 9^/ det<9„, 2 = 
det d Wl ®(det d W2 )*, the result is a flat complex line bundle. In the language of 
contemporary physicists, this is known as the cancelation of local anomalies. 
For some of their models, it is important to investigate the holonomies of the 
flat line bundle det 9^ <S> (detd W2 )* -the global anomalies. 

Let w[ and w' 2 be the spin structures on induced by wi and W2, where 
the diffeomorphism is specified by 7. Lee, Miller and Weintraub proved 
the following 

Theorem 65 ( ||61|| ) The holonomy of the flat complex line bundle 
det d m I det d W2 around a loop 7 is 




(6.10) 



holl'j] det d m / det d W2 ) 




If the fiber M 8k+2 



is a Riemann surface, then 



hoi (7; det d wl J det d W2 ) = exp — 2ni 



RjTfa w[) — RjT^, w' 2 ) 
8 
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6.3.3 Connection with Reidemeister torsion 

Let us now suppose that F = (f,bi), i = 1,2 are two spin diffeomorphisms 



of spin manifolds (M 8k 



+2 



1,2. Then there are well-defined spin 



structures w[, i = 1,2 on the mapping torus Tf. We may consider Tf as a 
bundle p : Tf — > S 1 over the circle S 1 with fiber M 8k+2 . As above we have 
two Dirac operators d w / e , i = 1,2 on the space of C°°-sections of the spin 
bundles over Tf and corresponding eta-invariants i](d w ' t ) and h(d w > e ). We 
also have a flat complex determinant line bundle det d wi / det d W2 over the 
base manifold S* 1 and its pullback p*(detd wi / detd W2 ) over Tf. Let 7 be the 
preferred generator of the fundamental group 7Ti(S' 1 ). 



Theorem 66 



r(T f ;p* (det d w J det d W2 )) =\ L f (X) \~\ 



where 



A = hol(j; det d Wl / det d W2 ) = 

r](d w > ie ) + h(d w > i€ ) rj(dw' 2 e) + h(d u 



limexp I — 2ni 



If the fiber M 8k+2 is a Riemann surface, then 



A = hol{j] det d wi / det d W2 ) = exp 



-2iri 



8 



Proof The connection between the Reidemeister torsion of the mapping 
torus and the Lefschetz zeta function follows from formula (6.8): 

r(T f ;p*(detd Wl /detd W2 )) =\ L f (X) \~\ 



where 

A = hol(g; det d Wl / det d W2 ) 
The result now follows from the previous theorem 65. 
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6.3.4 The Reidemeister torsion and theta-multipliers 

We recall some well known properties of theta-functions (see @]). Fix an in- 
teger g > 1. A characteristic m is a row vector m = (m\, ...,m*, m", m**) 
each of whose entries is zero or one. The parity e(m) = • m** + ... + m* • 
m** G of the characteristic m is said to be even (odd) when e(m) = 

(=!)• 

Let S g denote the Siegel space of degree g. We shall write elements 
T G Sp 2g (Z) as block matrices: 




The theta function with characteristic m is a function 9 m : S g x d? — > (U 



satisfying the following transformations law [|54| : 

e T . m (z(Cr + D)-\ (At + B)(Cr + D)' 1 ) = 
= 7m(T) ■ det(CV + D) 1/2 ■ exp (tuz(CV + D)' 1 t z) ■ d m {r, z) 

where 

T -m = m-T- 1 + ((D t C)o(B t A) ) (mod 2) 

and ( )o denotes the row vector obtained by taking the diagonal elements of 
the matrix. The number 7 m (^) is an eighth root of unity, and are known 
as the theta multiplier of T for the characteristic m. The action of the 
symplectic group Sp2 g (%) on the characteristic (denoted above m i— > T.m) 
preserves parity, and is transitive on characteristics of a given parity. We 
let r(m) = {T G Sp 2g (ZZ) \ T • m = m}. If T 2 is the principal congruence 
subgroup of level 2 in Sp 2g (^), i.e. 

Y 2 = {T eSp 2g (Z) \T = I (mod 2)}, 

then T 2 C r(m) for every m. 

For a diffeomorphism / : V 2 — >• V 2 of a Riemann surface V 2 of genus 
g, the induced map on the homology T = /* : Hi(V 2 ,%) — > Hi(V 2 ,Zj) is 
an element in the integral symplectic group Sp 2g (!Z). There is a bijection 
between the set of Spin structures on V 2 and the set of characteristics m. 
We shall let w m denote the spin structure corresponding to the characteristic 
m. Thus a diffeomorphism / : V 2 — > V 2 preserves the spin structure w m iff 
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/* : Hi(V, 2Z) — > H\(V, 2Z) is in r(m). If /* is in Y% then / preserves each 
of the spin structures on V 2 . Let T be any element of T 2 C Sp2 g (%) and 
/ : V 2 -> V 2 be a diffeomorphism with f m = T: H^V 2 , Z)) -> ^i(K 2 , ^). 
Consider again the bundle p : Tf — > S* 1 over the circle S" 1 with the fiber V 2 . 
Let w m and w n be two spin structures on V 2 corresponding to any two even 
characteristic m and n. We have a flat complex determinant line bundle 
detd Wm / detd Wn over the base S 1 and its pullback p*(detd Wm / detd Wn ) over 
the mapping tori Tf. 

Theorem 67 

r(T /; p*(det^ m /detO =| L / ( 7m (T)/ 7n (T)) I" 1 . 

Proof Lee, Miller and Weintraub |JT| proved that 

( rp\i (rr x ( o .R(T f ,w m ) - R(T f ,w n )\ 
7m(T)/7 n (T) = exp I -2m * J - 

Now the statement of the theorem it follows from theorem 66. 



6.4 Topology of an attraction domain and 
the Reidemeister torsion 

6.4.1 Introduction 

Assume that on a smooth compact manifold M of dimension n there is given 
a tangential vector field X of class C , and consider the corresponding system 
of differential equations 

% = X(x) t (6.11) 

Let (p(t, x) is the trajectory of (1) passing through the point x for t = 0. We 
shall say that the set / is the attractor or the asymptotically stable compact 
invariant set for system (1) if for any neighborhood U of I there is the neigh- 
borhood W, I C W C U such that 

1) for any x G W <f)(t, x) G U, if t G [0, +oo), 

2) for any x G W <f)(t, x) — > I, when t — > +oo. 
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By a Lyapunov function V(x) for attractor / we mean a function that 
satisfies following conditions 

1) v(x) e c\u-i), v{x)eC{u), 

2) V(x) > 0,x eU - I; V(x) = 0,xel, 

3) The derivative by virtue of the system (1) dV ^ > in U — I. 



Such Lyapunov function V(x) for / always exist [ 100|| . Suppose that S is a 



level surface of Lyapunov function V(x) in [/.The conditions 3) and the Im- 
plicit Function Theorem imply that the level surface S is a compact smooth 
n — 1-dimensional manifold transverse to the trajectories of (1) and trajecto- 
ries of (1) intersect S on the descending side of the Lyapunov function V(x). 
Any two level surfaces of the Lyapunov function V(x) are diffeomorphic.Note 
that manifold S is determined up to diffeomorphism by the behavior of tra- 
jectories of the system (1) in U — I and does not depend on the choice of the 
Lyapunov function V(x) and its level. Let N D I, dim N = n, be a compact 
smooth manifold with the boundary dN = S. 

In this article we will study the dependence of the topology of the attraction 
domain 

D = {x G M - I : (j)(t, x) — > J, when t — ► +00} 

of the attractor / and of the level surface S of the Lyapunov function V(x) on 
the dynamical properties of the system (1) on the attractor. The investigation 
of the topological structure of the level surfaces of the Lyapunov function was 
initiated by Wilson [ 100|| . Note that the attraction domain D is diffeomorphic 



to S x R , since each trajectory of system (1) in the invariant attraction 
domain D intersects n — 1-dimensional manifold S exactly once. Hence it 
follows that the homology groups of D and S are isomorphic. 



6.4.2 Morse- Smale systems 

We assume in this section that system (1) is given in R n and is a Morse-Smale 
system on manifold N, i.e. the following conditions are satisfied: 

1) A set of nonwandering trajectories Q of system (1) is the union of a finite 
number of hyperbolic stationary points and hyperbolic closed trajectories, 

2) Stable and unstable manifolds of stationary points and closed trajectories 
intersect transversally. 
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A stable or unstable manifold of a stationary point or a closed trajectory 
p is denoted by W s (p) and W u (p). Let a k be the number of stationary points 
p of system (1) in / such that dimW u (p) = k, b k is the number closed orbits 
q of system (1) in / such that dimW u (q) = k, M k = a k + b k + b k+ i, 
B k = dimH k (D; Q) = dimH k (S; Q), x{D) = x(S) is the Euler characteristic 
of D and S. 

Theorem 68 The numbers B k and M k satisfy the following inequalities: 

B <M + M n _! - M n , 

B 1 -B <M 1 -M + M n _ 2 - M n _! + M n , 
B 2 -B 1 + B <M 2 -M 1 + M + M n _ 3 - M n _ 2 + M n ^ - M n , (6.12) 



n— 1 n 

EC- 1 )* • * = x(s) = x(d) = (i + (-lr 1 ) E(-ir • i^. 

i=0 i=0 

To prove the theorem we need several preliminary definitions and lemmas. 
Lemma 36 

B r = B r {N) + B n ^ r {N), (6.13) 
where B r (N) = dim H r (N; Q). 

Proof It is possible to assume that S lies on the n-dimensional sphere 
S n . Suppose C = Cl(S n — N) is the closure of the complement of N. Then 
S = C fl N. The manifolds C and iV are compact and intersect only on the 
boundary. Consequently, we have the exact reduced Maier-Vietoris sequence 



.... -> H r+1 {S n - Q) -> H r (S; Q) -> H r (N\ Q) © F r (C; Q) -> F r (5"; Q) -> ... 

Set 1 < r < n - l.Then F r (5 n ; Q) = H r+ (S n ; Q) = 0, and therefore 

H r (S; Q) = H r {N; Q) © H r (C; Q). 

Hence B r (S) = B r (N) + B r (C), where B r denotes the dimension of if r .From 
Alexander duality it follows that B r (C) = B r (N — dN) It is easy to show 
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that N and N — dN are homotopically equivalent ( for example, by means of 
the collar theorem). Therefore5 r (iV — dN) = B r (N), hence 

B r (S) = B r (N) + B n ^ r (N) and B r (S) = B r (N) + B n _!_ r (N). 

The manifold S is closed and orientable ; therefore in case r = n — 1 we 
obtain the following from Poincare duality: 

B (S) = B (N) + B n ^(N). 

Thus the lemma is proved for allr = 0,l,2,...,n — 1. We make the 
following definition: 

Definition 16 The stationary point p of the vector field X with dim W u (p) = 
k has standard form if there exist local coordinates x±, £2, Xk] 2/1,2/2, •-, y n -k 
in some neighborhood of the point p such that 

^ d d d d 
X = xi- h + x k - yi- .... - y n - k - 



ox 1 dx k dyi oy n _ k 

in this neighborhood. 

The standard form for a closed trajectory is defined analogously |38 



Lemma 37 pSj] If Xq is a Morse-Smale vector field on the manifold N , then 
there exists a path in the space of smooth vector fields on N, X t , t G [0, 1], 
such that: 

1) Xt is a Morse-Smale vector field for all t e [0, 1]; 

2) the stationary points and closed trajectories of the field X\ are all in 
standard form. 

By using this result we replace the original vector field by a vector field for 
which all stationary points and closed trajectories have standard form. 



Lemma 38 fiJBJ Suppose X is a Morse-Smale vector field on an orientable 
manifold, 7 is a closed trajectory in standard form, dim 1^(7) = k + 1, U 
is a sufficiently small neighborhood 0/7. There exists a Morse-Smale vector 
field Y which coincides with x outside of U, in U has stationary points p and 
q, and has no other stationary points or closed orbits. Moreover dimW u (p) = 
k,dimW u (q) = k + l. 
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By means of this lemma we replace a vector field on the manifold iV 
by the field Y having no closed trajectories. In this connection the number 
of stationary points of the field Y with dimW""(p) = k will be equal to 
O'k + bk + b k+ i 

Lemma 39 J&|/ Suppose Y is a smooth Morse-Smale vector field without 
closed trajectories on a compact manifold N with boundary, the stationary 
points of Y have standard form, and the vector field on dN is directed in- 
ward. Then there exists a Morse function f on N such that: 

1 ) the critical points of the function f coincide with stationary points of the 
field Y , the index of a critical point of the function f coincides with the di- 
mension of the unstable manifold of this point ; 

2) if p <E N is a critical point of f then f{p) = dimW u (p); 

3) f(dN) = 2±i. 



Lemma 40 Jgfl/ Suppose f is a Morse function on N satisfying 
conditions 1) - 3). Then: 

B {N) < M , 
B 1 (N) - B (N) < M x - M , 
B 2 (N) - B,(N) + B (N) <M 2 -M 1 + M , (6.14) 

n n 

£(-!)' • B t (N) = X (N) = XX-l)* • M,. 

i=0 i=0 

Corollary 25 The following inequalities hold: 

B n -i{N) < M n -!-M n , 
B n _ 2 (N) - £ n _i(iV) < M„_ 2 - M n ^ + M n , 
B n _ 3 (N) - B n _ 2 (N) + S n _!(JV) < M„_ 3 - M„_ 2 + M n _ x - M n , (6.15) 

n—1 n—1 

E(-ir • Bi(N) = X (N) = (i + (-lr 1 ) • 

1=0 i=0 
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Proof of the corollary. From the fact that H n (N) = it follows that 

- B^N) + B n _ 2 (N)... + (-l) n B (N) = M n - M n ^... + (-l) n M (6.16) 

Adding (6.16) to the inequalities (6.14) and subtracting (6.16) from the in- 
equalities (6.14) we obtain system of the inequalities (6.15). 

Proof of Theorem 68 From lemma 1, inequalities (6.14) and (6.15) 
it follows that 

B k - B fe _! + B k _ 2 - ... + (-l) k B = B k (N) - Bk-i(N) + ... + (-l) k B (N) + 

+B rM {N) - B n _ k (N) + B n _ k+1 (N) + .... + (-l) fc S n _!(JV) < 
< M k M, , • + (-l) k M +M n .^ k -M n . k + +(-l) fe M n _ 1 -(-l) fc M n ; 

X (S) = E(-l) fe • B k = J2(-l) k (B k (N) + B M {N)). 

k=0 k=0 

Using the fact that H n (N) = and changing the index of summation we 
obtain 



X (s) = (i + (-1)- 1 ) £(-iy • b^n) = (i + (-lr 1 ) E(-ir • Mi 

i=0 i=0 

The theorem is proved. 

6.4.3 A formula for the Euler characteristic 

The last identity in Theorem 68 is also true in more general situation. 
Namely, assume that system (6.11) is an autonomous system of differential 
equations having a finite number of stationary points in attractor I. Denote 
by Index (p) the indices of the vector field X at stationary point p. 

Theorem 69 

X (D) = X (S) = ((-I)" - 1) • E Index (P)- ( 6 - 17 ) 

pel 
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Proof The vector field X is directed on dN into N . Therefore from the 
Poincare-Hopf theorem ||65j| , by replacing X by —X we obtain 

x(iV) = (-ir-£m%). 

pel 

It is known that x(dN) = (1 + (-l) n_1 ) ■ x(iV). Hence 

X (D) = X (S) = ((-l) n " 1) ■ E In dex (p). 

pel 



Corollary 26 Suppose the stationary points on I are hyperbolic , is the 
number of stationary points of I with d\mW u (p) = k. Since for a hyperbolic 
stationary point p with dim W u (p) = k the index of the vector field at it is 
equal to (— l) k , we obtain the following formula: 

n 

X (D) = X (S) = ((-IT - 1) • El" 1 )" • a*- (6-18) 

fc=0 

For n = 3 S is union of finite number of spheres with handles. Suppose m is 
the number of connected components, p is the total number of handles of the 
manifold S. Then x(S) = 2m — 2p. Hence we obtain 

Corollary 27 

m — p = — E Index (p). (6.19) 

p&i 

In the case, when stationary points are hyperbolic 



m — p = a Q — a\ + a 2 — a%. 



6.4.4 The Reidemeister torsion of the level surface of a 
Lyapunov function and of the attraction domain 
of the attractor 

In this section we consider the flow (6.11) with circular chain recurrent set 
R <Z I .The Reidemeister torsion of the attraction domain D and of the level 
surface S is the relevant topological invariant of D and S which is calculated 
in theorem 70 and corollary 28 via closed orbits of flow (6.11) in the attractor 
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I. 

The point x G M is called chain-recurrent for flow (6.11) if for any e > 
there exist points Xi = x,x%, ...,x n = x and real numbers t(i) > 1 such that 
p(<f>(t(i), Xi), x i+ i) < e for 1 < % < n . Let R C / be a set of chain-recurrent 
points of equation (6.11) on the manifold N defined above. We assume in 
this section that R is circular , i.e. there is a smooth map 9 : U —>■ R l /Z, U 
a neighborhood of R in N, on which o (f>(t,x)) > 0. In other words, 
there is a cross-section of the flow (6.11) on R , namely , a level set of 6 
on int{U) . For instance, if R is finite i.e., consists of finitely many closed 
orbits, then R is circular. More generally, if on has no stationary points 
and the topological dimension of R is 1, then R is circular. For example ,if 
is a nonsingular Smale flow , so that R is hyperbolic and 1-dimensional, 
then R is circular. If U G N is such that f\teR 1< t>t(U) = J is compact and 
J G intU , then we say that U is an isolating neighborhood of the isolated 
invariant set J. According to Conley [14]], there is a continuous function 
G :— > R 1 such that G is decreasing on N — R and G(R) is nowhere dense in 
R 1 . Taking an open neighborhood W of G(R) and U = G^ l {W), we see that 
U is an isolating neighborhood for some isolating invariant set J and that 
J — > .R as W — > G(i?) HOI. This proves that the chain recurrent set i? can be 
approximated by the isolated invariant set J .In particular we can make J 
circular. Further, there are finitely many points X{ < Xi + \ in R 1 —G(R) such 
that isolates an invariant set Jj so that J = UJj is as closes as 

we like to R . In particular, we can make J circular. For the sequel we need 



the isolating blocks [14]. A compact isolating neighborhood Bi of Jj is said 
to be isolating block if: 

1) Bi is smooth manifold with corners, 

2) dBi = bf U 6, r U 6° where each term is compact manifold with boundary, 

3) the trajectories <j)(t,x) is tangent to 6° and db® = (bf U b^) n 6° , 

4) the trajectories 4>{t,x) is transverse to bf and b~ , enters Bi on bf and 
exists on bj . 

Since J« is circular there is a smooth map 0j : Z?j — > R 1 /Z such that Jj(#j ° 
4>(t,x)) > on -Bj.By perturbing 0j, we can make 0, transverse to G R 1 /Z 
on B h bf,br,bldbf,db~,dbl Now let ^ = ^ x (0) U b~ , Z, t = b; . Then 
(Y;, Zj) is a simplicial pair . We define a continuous map r« : Yj — ► Fj as 
follows. If yi G" Zj then rj(y) = <p(r,y) where r = r(y) > is the smallest 
positive time £ for which <p(t, y) G Fj. Since (j)(t, x) is transverse out on b^OZi, 
we see that r(y) is near for y near Zj.Thus r extends continuously to Zi 
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if we set r/Zi = 0. Now let £ be a flat complex vector bundle of finite 
dimension on Bi. There is a bundle map aj : r*(E\Y) — > E\Y{ defined by 
pulling back along trajectory from y to r^y), using the flat connection on 
.E.This determines an endomorphism 

(a,). : H*(Y h Z t ; r*E) - H*(Y h Z f , E). (6.20) 

Since there is a natural induced map r* : H*(Y iy Zf, E) — > H*(Yi, Zf, r*E) we 
obtain the endomorphism 

A = (a,)* • r* : H*(Y h Z { ; E) -> H*(Y i7 Z <; E). (6.21) 

So the relative Lefschetz number 

n-1 

L(A) = E(-!) fc - Tr (A)* (6-22) 

k=o 

is defined. According to Atiyah and Bott [|TJ the numbers L(/3j) can be 
computed from the fixed point set of rj in Y, — Zj.If Fix (rj) — Zj is a finite 
set of points p with the Lefschetz index Index z,(rj,p) and («j) p : E p — > 
is the endomorphism of the fiber at p, then one has the relative Lefschetz 
formula 

L(A) = £ Index ifa,p) • Tr (ai)p- ( 6 - 23 ) 
p 

We see that L(/3"), n > 1 , counts the periodic points of period n for $ which 
are not in Z, i.e. the closed orbits of system (6.11) that wrap n times around 
R 1 1 Z under 9i, with a weight coming from the holonomy of E around these 
closed orbits. Now , consider the twisted Lefschetz zeta function [40| for E 
and (Bi,bi): 

L t (z) = L Pi {z) ■= exp ^p-z n ^j (6.24) 

we now turn to the i?-torsion of pairs. Suppose that L is a CW-subcomplex 
of K and consider the relative cochain complex 

C*(K, L- E) = ker{C*{K- E) -> C*{L; E\ L )). 

Then one has a natural isomorphism \C*(K, L; E)\ = ®j|V|, where j runs 
over the i-cells in K\L. So our flat density on E gives a density A, on the rela- 
tive z-cochains in E. Thus we again have an R-torsion denoted r(K, L; E, Dj) 



Reidemeister torsion 



140 



for some choice of positive densities Di on H l (K, L; E). If H l (K, L; E) = 0, 
we say that E is acyclic for (K, L) and we simply write t(K, L; E), when the 
Di are chosen standard. Let pe '■ iri(N,p) — > GL(E P ) is holonomy represen- 
tation for acyclic bundle E on orientable manifold N, dim N = n, p* E is the 
cotragredient representation of pe and E* is a flat complex vector bundle 
with the holonomy p* E . We suppose that det pe = 1. Let L*(z) is the twisted 
Lefschetz zeta function for E* and (Bi,b^), and 

IKC*). ^)=II^)- (6-25) 



Theorem 70 

t(D;E!)=t(S;E) = \L(l)\~ l ■ \L*(l)\< n \ (6.26) 

where e(n) = (— l) n . 

Proof Consider the function G. Smoothing the level set G~ 1 {x,i) by 
sliding it along the flow, one obtains a smooth region Ni G N with 

G _1 ((-oo, Xi - e)) C G _1 ((-oo, x { + e)) 

, such that the trajectories <p{t,x) transverse to dNi, for large % we have 
Ni = N and dN~ = 0. If e is small one has that iVj+i — iVj isolates Jj.Then 



by properties of the Reidemeister torsion [4^| one finds: 



t(N;E) = Y[r(N t+1 ,N t ;E) ^H^k; E) (6.27) 

i i 

D. Fried proved [4(| that E is acyclic for (Bi,b~) iff J — /3j is invertible and 
then 

r(S i ,6 j ;^) = l^i(«)r 1 |*=i (6-28) 

So we have 

r(JV;£0 = ni^(l)|- 1 = mi)|- 1 (6-29) 

i 

From the multiplicative law (6.1) for the Reidemeister torsion it follows: 



t(N; E) = t{N, dN = S;E)- r(dN = S; E) (6.30) 
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Using Milnor's duality theorem for the Reidemeister torsion [B3[] we have: 

r(N,dN = S;E) =r(N;E*) { - 1)n (6.31) 
From formula (6.29) it follows that 

r(N;E*) = H\L*(1)\- 1 = \LW\- 1 (6.32) 

i 

Since the attraction domain D is diffeomorphic to S x R l then the Reide- 
meister torsion r(D; E) = t(S; E) by the simple homotopy invariance of the 
Reidemeister torsion. Now from (6.29), (6.30), (6.31), (6.32) we have: 

t(D; E) = t(S = ON; E) = t(N; E) ■ t'^N, dN = S;E) = 

= t(N; E) ■ t{N; E*)^ n+1 = | 1 • ^(l)^ 1 )" 

Suppose now that the system(6.11) on the manifold N is a nonsingular 
almost Morse-Smale system. This means that (6.11) has finitely many hy- 
perbolic prime periodic orbits 7 and no other chain-recurrent points. Over 
the orbit 7 lies a strong unstable bundle E u {j) of some dimension ^(7). Let 
5(7) be +1 if E u is orientable and —1 if it is not. Let 5(7) = (— 1) u (t) 

Corollary 28 

t(D;E) = t(S = dN; E) = 

= n I det(J - 5(7) ■ Pe{iW M x (II I det(J - tf( 7 ) • p^(7))| £(7) ) ( " ir+1 

7 7 

Proof According to D. Fried [[EJ if J, is a prime hyperbolic closed orbit 
7 then 

|L J (l)|- 1 = |det(/-5(7)-p s (7))| £W 
Now, the statement it follows from theorem 70. 



6.5 Integrab le Hamiltonian systems and the 
Reidemeister torsion 

Let M be a four- dimensional smooth symplectic manifold and the system 
(6.11) be a Hamiltonian system with a smooth Hamiltonian H. In the Dar- 
boux coordinates such system has the form: 
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^ = ^ (6-33) 
dt dqi v ; 

dqi dH 
dt dpi 

As the Hamiltonian H is the integral of the system (6.33), then three- 
dimensional level surface Q = [H = const] is invariant for the system (6.33). 
The surface Q is called the isoenergetic surface or the constant -energy sur- 
face. Since M is orientable( as a symplectic manifold), the surface Q is 
automatically orientable in all cases. Suppose that the system (6.33) is com- 
plete integrable (in Liouville's sense) on the surface Q. This means, that 
there is the smooth function /(the second integral), which is independent 
with H and for the Poisson bracket [H, f] = Oin the neighborhood of Q. 
We shall call the integral / a Bott integral on the isoenergetic surface Q, if 
its critical points form critical nondegenerate smooth submanifolds in Q.This 
means that Hessian d 2 f of the function / is nondegenerate on the planes nor- 
mal to the critical submanifolds of the function /. A.T. Fomenko |37| proved 
that a Bott integral on compact nonsingular isoenergetic surface Q can have 
only three types of critical submanifolds: circles, tori, Klein bottles. The 
investigation of the concrete systems shows J57J that it is a typical situation 
when the integral on Q is a Bott integral. In the classical integrable cases of 
the solid body movement ( cases of the Kovalevskaya, Goryachev-Chaplygin, 
Clebsch, Manakov) the Bott integrals are a round Morse functions on the 
isoenergetic surfaces. The round Morse function is a Bott function all whose 
critical manifolds are circles. Note that critical circles of / is a periodic so- 
lution of the system(6.33) and the number of this circles is finite. Suppose 
now that the Bott integral / is a round Morse function on the closed isoen- 
ergetic surface Q. Let us recall the concept of the separatrix diagram of 
the critical circle 7 for a Bott function /. Let x G 7 be an arbitrary point 
and Nxi'y) be a disc of small radius normal to 7 at x. The restriction of / 
to the Nx{^i) is a normal Morse function with the critical point x having a 
certain index A = o, 1, 2. The separatrix of the critical point x is the integral 
trajectory of the field grad/, which is entering or leaving x. The union of all 
the separatrices entering the point x gives a disc of dimension A and is called 
the incoming separatrix diagram(disc). The union of outgoing separatrices 
gives a disc of additional dimension and is called the outgoing separatrix 
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diagram(disc). Varing the point x and constructing the incoming and out- 
going separatrix discs for each point x, we obtain the incoming and outgoing 
separatrix diagrams of circle7. Let ^(7) be the dimensi on of the outgoing 
separatrix diagram of 7, and 5(7) be +1 if this separatrix is orientable , and 
-1 if it is not. Let 5(7) = (— 1)"™. Suppose that pe '■ ^i(Q,p) — » GL(E p ) is 
holonomy representation for acyclic bundle E over Q; E p is a fiber at point 
p. 



Theorem 71 

r(Q; = n I det(J - 8(j) ■ p E (lW h) (6.34) 
7 

Proof As a Bott integral / on Q is a round Morse function then ac- 
cording to Thurston |)2| Q has a round handle decomposition whose core 
circles are critical circles of /. According to Asimov || if Q has a round 
handle decomposition then Q has a nonsingular Morse-Smale flow whose 
closed orbits are exactly the core circles of the round handles, i.e. critical 
circles 7 of /. Consider this nonsingular Morse-Smale flow. For a closed or- 
bit 7 of such flow the dimension ^(7) of unstable manifold ^"(7) is exactly 
the dimension of the outgoing separatrix diagram of 7 as critical circle of 
/. One can choose as isolating block B for 7 to be a bundle over S 1 with 
fiber F a simplicial disc so that F = I u x I s , u = ^(7), s = 4 — ^(7), and 
F fl b~ = dl u x I s c F. By collapsing I s to a point one can produce a simple 
homotopy equivalence of (B, b~) to (X 7 , <9X 7 ) where X 7 is the unstable disc 
bundle over 7. Give Q its Smale filtration by compact submanifolds Qi of 
top dimension so that Qi C intQ i+ i,Q Q = ®,Qi = Q for large i , flow is 
transverse inward on dQi and Qi+i — Qi is an isolating neighborhood for a 
hyperbolic closed orbit 7. Then (Q i+ i,Qi) has the same homotopy type as 
(Xy, <9X 7 ) and by properties of the Reidemeister torsion |40| one finds: 



r(Q;E) =Y[r(Q l+1 ,Q i; E) =Y[r(X y ,dX y ;E) 

i 7 

= nidet(/-5(7)-p £ ( 7 ))| £W . 
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